Pipeline Driven · by Roy Osherove
What is a pipeline driven organization?
A Pipeline Driven Organization is operating around the idea that automated pipelines make the important IT decisions:
- Commit
- Is the code releasable?
- Build
- Are the infrastructure changes OK?
- Are we compliant and secure?
- Test
- Is a feature working?
- Deploy
- When is it OK to deploy a new version?
- When and how to deploy a new environment
- Learn
- When to rollback (or forward) a new version
Who makes the call?
Traditional organizations
In traditional organizations, even though automated pipelines may exist, they do not make the important & continuous IT decisions. Humans do.
Pipeline driven organizations
In a pipeline based organization, experts from various categories of work spend their time teaching the pipelines how to make proper decisions (using automated specialized tests). In this way they can trust the pipeline enough to let it make the decisions instead.
Diagram
Co-Ops - A Cooperative Pipeline
Latest posts
Archive · 2014–2022
-
A Metrics Framework for Continuous Delivery
Here’s a framework I like to start with when I discuss what types of metrics can help or harm you in your journey to continuous delivery: Lagging Indicators At the organizational level, unit tests are usually part of a…
-
Video: Lies, Damned Lies and Metrics
I spoke about what types of metrics and KPIs (including OKRs) you can use with continuous delivery, and which ones you might want to stop using, during my talk at GOTO 2019. Also discussed: Leading and Lagging…
-
If a Build Takes 4 hours, Run It Every 4 Hours
(Note: You might need to fix your environment bottlenecks first before being able to act on this blog post) Builds (i.e. compile + run tests + deploys + more tests etc…) represent a bottleneck for getting feedback on our…
-
Co-Ops: Enabling True Continuous Delivery with Cooperative Pipelines & Processes (Title Feedback Needed)
“Co-Ops” is a term that one of the attendees at a talk I was giving about cooperative pipelines came up with. I wish I knew his name. I asked him to email me afterwards so I can credit him but he never did. Co-Ops…
-
Video: The Pipeline Driven Organization - Enabling True Continuous Delivery (Oredev 2019)
Roy Osherove — The Pipeline Driven Organization｜ Øredev 2019 · YouTube
-
Continuous Delivery Israel Meetup - First Meeting June 24 2019
I’m pleased to announce that we will have the first ever meeting Continuous Delivery Israel meetup, in the AWS Floor28 offices in Tel Aviv, June 24th, 2019, at 6PM. The Group’s page is located at CDIsrael.com If you…
Browse by line
Every post sits on one of six topic lines.
-
Build Patterns
Fast, maintainable builds: shipping skeletons, script injection, rolling builds.
- If a Build Takes 4 hours, Run It Every 4 Hours
- Guidelines for selecting tools for continuous delivery toolchains
- The first rule of continuous delivery toolchains
-
Testing
Pipeline-friendly test strategies and trustworthy, noise-free pipelines.
- Delivery Pipelines and Discovery Pipelines
- Red Pipelines and Build Whisperers: Getting to a Trustworthy Noise Free Test Pipeline
- A Pipeline Friendly Layered Testing Strategy & Recipe for DEV and QA
-
Metrics
What to measure on the way to continuous delivery, and what not to.
- A Metrics Framework for Continuous Delivery
- Ten Devops & Agility Metrics to Check at the Team Level
- DevOps Metric: Amount of Defects and Issues: definition.
-
Environments
Ephemeral environments and the cost of static ones.
- Ephemeral Environments for DevOps: Why, What and How?
- The four biggest issues with having static environments
- Parallel Firehose
-
Enterprise DevOps
DevOps values at scale: approvals, monoliths, compliance, culture.
- Co-Ops: Enabling True Continuous Delivery with Cooperative Pipelines & Processes (Title Feedback Needed)
- "Pipeline Driven" vs. "We have Jenkins Jobs"
- Always start with a "Why" when transforming to DevOps.
-
Talks & Events
Conference talks, interviews and meetups.
- Video: Lies, Damned Lies and Metrics
- Video: The Pipeline Driven Organization - Enabling True Continuous Delivery (Oredev 2019)
- Continuous Delivery Israel Meetup - First Meeting June 24 2019
Resources
- WatchTalks and videosConference talks on pipelines, enterprise DevOps and testing.
- LibraryBeautiful Builds8 short videos and the book on build patterns.
- ReadRecommended DevOps booksRoy’s shortlist, from Continuous Delivery to The Goal.
- ToolsFeature toggle frameworksFeature flag libraries by language.
By Roy Osherove
Roy Osherove helps software organizations deliver continuously. He is the author of The Art of Unit Testing, Elastic Leadership and Enterprise DevOps, and speaks about pipelines, testing and team leadership at conferences such as Øredev.