Skip to content

March 30, 2012

The Convergence of DevOps

By John Willis

I’d like to describe how DevOps is the culmination of three amazing and significant movements. This is what we’re putting into the DevOps Cookbook [later retitled The DevOps Handbook].

So the saying goes “If I could have a nickel for every time I have heard the expression “Cloud? We’ve been doing that for 20 years!” I would be a …”

So goes DevOps.  The funny thing is that most people are right in saying “we’ve been doing DevOps for years.”  That’s mainly because there is not good canonical definition for DevOps.  However, the purpose of this post is not to debate the definition of DevOps; moreover, it’s to help describe and understand the movement’s history.

Last year, when asked to deliver the keynote for the DevOpsDays MoutainView 2011,  I gave a presentation called “DevOps State of the Union.”  I identified three distinct threads that helped us arrive at the current healthy debate and movement we call DevOps.  Of course this is not the only list; but I believe it’s an excellent place to start.

The Agile Infrastructure Thread

Probably the most recognized thread is the one that starts with Patrick Debois (@patrickdebois) and Andrew Shafer (@littelidea).  At the Agile 2008 conference Patrick and Andrew tried to run a BOF called “Agile Infrastructure”. Unfortunately no one came.  However, around the same time Marcel Wegerman had started an agile-sysadmin mailing list in Europe that Patrick was heavily involved with.  This list was instrumental in promoting a bridge between development and systems administration.

I first heard of the agile infrastructure concept while listening to Andrew, Isreal Ghat (@agile_exec) and Michael Cote (@cote) on a Redmonk podcast.  I was so excited I had to pull my car off the road to take notes.  I immediately called Andrew and he turned me on to Patrick and the work he was doing.  Actually it’s more of an accident that the term “DevOps” came to be,  Patrick was so excited about John Allspaw’s seminal Velocity 2009 presentation titled “10+ Deploys Per Day: Dev and Ops Cooperation” he decided to create a two day conference called DevOps Days in Ghent in late 2009.  At the time I was working as a cloud evangelist for Canonical and I somehow convinced my then boss Simon Wardley (@swardley) to let me attend this this first time event.  I knew this conference was going to be an important event for the growth of cloud computing, but, I credit Simon for having foresight to sponsor my attendance.  Cloud and Devops who knew?

In my option, this event was the closest, we will ever get to a “DevOps Manifesto.”  The passion and influencers in this event, even with less than 50 attendees,  created the start of the DevOps movement around the world.  Many participants, including Lindsay Holmwood (@auxesis) from Australia and Julian Simpson (@builddoctor), R.I. Pienaar (@ripienaar), Chris Read (@cread) and Stephen Nelson-Smith (@lordcope) from the UK, went on to found DevOps Days in their respective countries. I came back to the good old USA and started blogging and spreading the good news.

With the help of Damon Edwards (@damonedwards),  Andrew Shafer (@littelidea) and Jesse Robins (@jesserobbins) we were able to pull off the first US based DevOps Days in Moutainview in 2010. Bringing together some of the brightest operations experts in America,  DevOps Days Mountainview proved to be another milestone event for the movement. Namely because it was the first event where analysts were in attendence.  In fact, it was this event that sparked Jay Lyman of the 451 Groups to write the  first ever analyst report on DevOps.  I guess the rest, as they say, is history.

The Velocity Thread

Most people will cite John Allspaw’s (@allspaw) Velocity 2009 presentation titled “10+ Deploys Per Day: Dev and Ops Cooperation” as a pivotal moment in the Devops movement.  I was fortunate enough to be at that presentation and it blew me away.  You can image the headline of 10+ deploys a day.  It brought shock and awe to the room.  Ten plus deploys a day? That can’t possibly work.  Taking some creative license in recounting this event, I swear there were people throwing up in the back of the room from the sheer horror they had just witnessed.

Like Patrick,  John is an icon for the Devops movement; however, there is a little pre-history that deserves some deeper investigation on this thread.  In 2007 I stumbled upon a great post by Jesse Robbins on O’Reilly Radar titled “Operations is a competitive advantage… (Secret Sauce for Startups!).”  For the first time Jesse was introducing technical debt as not just a metaphor for software development but applying it to operations as well. In his article he has a link to another great post done by Tim O’Reilly in 2006 called “Operations: The New Secret Sauce.”  This is what I call “Tim’s Operations Elephant in the Room Epiphany.” Tim’s epiphany, along with a lot of Jesse’s hard work, created the Velocity conference.  Without Patrick, John, and Jesse, the DevOps movement may have never gained the traction necessary to really take off.

The Lean Startup Thread

But wait there more…  I would be remiss if I didn’t mention the influence of Lean on DevOps.  More importantly the subliminal impact Eric Ries has had on DevOps.

This story starts with a book called “Four Steps to the Epiphany” written by Steven Blank. Four Steps’s Customer Development Methodology was a major influence of Eric Ries’ Lessons Learned blog and his eventual book title “Lean Startup”.  Eric took many of the great “Lean Manufacturing” ideas combined with Blank’s approaches and built his first startup called IMVU.  It was there he blogged about the methods he used while engineering the startup.  Eric and Blank’s influence reaches far beyond just their books.

The Lessons Learned  blog Eric created had a major impact on many Silicon Valley startups between 2007 and 2010.  One such startup, a company called Wealthfront, now an undisputed poster child for the implementation of DevOps, not surprisingly, was directly influenced by Eric.  Eric acted as an advisor to Wealtfront and drove a lot of their operational engineering decisions.

Last but not least this thread would be incomplete without a to shout to Jez Humble (@jezhumble) of Thoughtworks. on his work with ‘Continous Delivery.”  I am not sure how much influence Blank and Ries played a role in Jez’s canonical source on “Continuos Delivery, but I am certain he (Jez) deserves a place holder in this thread.

- About The Authors
Avatar photo

John Willis

John Willis has worked in the IT management industry for more than 35 years and is a prolific author, including "Deming's Journey to Profound Knowledge" and "The DevOps Handbook." He is researching DevOps, DevSecOps, IT risk, modern governance, and audit compliance. Previously he was an Evangelist at Docker Inc., VP of Solutions for Socketplane (sold to Docker) and Enstratius (sold to Dell), and VP of Training & Services at Opscode where he formalized the training, evangelism, and professional services functions at the firm. Willis also founded Gulf Breeze Software, an award winning IBM business partner, which specializes in deploying Tivoli technology for the enterprise. Willis has authored six IBM Redbooks for IBM on enterprise systems management and was the founder and chief architect at Chain Bridge Systems.

Follow John on Social Media

15 Comments

  • goalarab May 17, 2022 1:23 am

    Thank you for sharing this great and useful post.

    Reply

  • rabab saad Nov 23, 2021 7:56 pm

    Thank you for sharing this great and useful post.

    Reply

  • pntre Feb 4, 2016 12:03 pm

    اذا كنت تبحثين وتفكرين وتضعين وقت في البحث عن افضل طريقة عمل الملوخية سارعي في متابعة موقع باتيه وانتريه وسوف تحصلين على اروع وصفة للملوخية الخضراء الراءعة ذات طعم شهي ولذيذ احصلي على الطريقة عبر الموقع الالكتروني https://goo.gl/w6plQf

    Reply

  • BMC Doubles Down On DevOps, Acquires VaraLogix | Startup Help Aug 8, 2012 3:59 pm

    [...] “DevOps” is a nebulous term referring to, among other things, the application of methods from agile software development to IT operations. Automation is a big theme and tools like Puppet (backed by Puppet Labs) and Chef (backed by Opscode) are popular tools. [...]

    Reply

  • BMC Doubles Down On DevOps, Acquires VaraLogix | Gaster Tech Blog Aug 8, 2012 1:58 pm

    [...] “DevOps” is a nebulous term referring to, among other things, the application of methods from agile software development to IT operations. Automation is a big theme and tools like Puppet (backed by Puppet Labs) and Chef (backed by Opscode) are popular tools. [...]

    Reply

  • BMC Doubles Down On DevOps, Acquires VaraLogix | TechCrunch Aug 8, 2012 11:46 am

    [...] “DevOps” is a nebulous term referring to, among other things, the application of methods from agile software development to IT operations. Automation is a big theme and tools like Puppet (backed by Puppet Labs) and Chef (backed by Opscode) are popular tools. [...]

    Reply

  • Mike Orzen May 12, 2012 9:04 am

    Excellent post John! The concepts around DevOps is "lean thinking" applied to the lifecycle of an app or system. Lean is a gathering of many great thinkers (Ford, Deming, Ohno, Shingo, Womack, Rother to name a few). It is not surprising that DevOps is also a melting pot of ideas and, by its very nature, evolving as new insights and levels of understanding are uncovered.

    Reply

  • jezhumble Apr 30, 2012 6:46 pm

    Thanks for the shout out John. Dave and I had been writing the book for three years when Tim Fitz' continuous deployment post came out, and I came across Steve Blank's work at about the same time. However I failed to do my research thoroughly enough, and the first I heard about Eric Ries was when someone tweeted that I had stolen his ideas after our book came out (fortunately Eric is a great guy and we defused that particular bomb). I love the fact you describe the movement as a "convergence". That's exactly how it felt to me. The Continuous Delivery book itself is a convergence of experiments many of us in ThoughtWorks had been working on for several years, mainly in the "enterprise" IT space. It became clear in the year before the book was published that there were multiple other independent streams - as you describe here - that were all pursuing the same train of thought within other communities (proof that software people are - ironically - still crap at communication). Having set out to write a niche book on the utterly dry topic of build and release management, I am still amazed that this stuff has become cool, and excited that as a community we might actually help to leave IT in a better state than we found it.

    Reply

    • Jez Humble Sep 7, 2012 11:28 pm

      PS the beginning of the "continuous delivery" thread was a paper presented by me, Chris Read, and Dan North at Agile 2006 called the Deployment Production Line - https://continuousdelivery.com/wp-content/uploads/2011/04/deployment_production_line.pdf - that disappeared without trace. I guess its time had not come - plus we did a pretty bad job of writing it up.

      Reply

  • Jesse Robbins Apr 3, 2012 6:13 pm

    John, this is an exceptional post.   I owe my own thanks to Brady Forrest & Artur Bergman who recruited me to O'Reilly Radar.  That put me in a position to lobby Tim O'Reilly to create a home for our tribe.   Tim's story of that history is here: https://www.youtube.com/watch?v=MH9qxqPMYGk-Jesse

    Reply

Leave a Comment

Your email address will not be published.



Avatar photo

John Willis
Jump to Section

    More Like This

    High Stakes Communication: The Four Pillars of Effective Leadership Communication
    By Summary by IT Revolution

    You've been there before: standing in front of your team, announcing a major technological…

    Read Article
    Mitigating Unbundling’s Biggest Risk
    By Stephen Fishman , Matt McLarty

    If you haven’t already read Unbundling the Enterprise: APIs, Optionality, and the Science of…

    Read Article
    Navigating Cloud Decisions: Debunking Myths and Mitigating Risks
    By Summary by IT Revolution

    Organizations face critical decisions when selecting cloud service providers (CSPs). A recent paper titled…

    Read Article
    The Phoenix Project Comes to Life: Graphic Novel Adaptation Now Available!
    By IT Revolution

    We're thrilled to announce the release of The Phoenix Project: A Graphic Novel (Volume…

    Read Article