July 15, 2020
Managing an Evolving Transformation—A Scorecard Approach

Mirco Hering is the author of DevOps for the Modern Enterprise. This blog post was originally published on NotAFactoryAnymore.com.
I have been speaking over the last couple of years about the nature of DevOps and Agile transformations. It is in my view not possible to manage them with a simple As-Is To-Be approach as your knowledge of your As-Is situation is usually incomplete and the possible To-Be state keeps evolving. You will need to be flexible in your approach and need to use agile concepts. For successful Agility you need to know what your success measures are, so that you see whether your latest release has made progress or not (BTW something way too many Agile efforts forget). So what could these success measures look like for your transformation?
Well there is not one metric, but I feel we can come up with a pretty good balanced scorecard. There are 4 high level areas we are trying to improve: Business, Delivery, Operations and Architecture. Let’s double click on each:
- Business: We are trying to build better solutions for our business and we know we can only do this through experimentation with new features and better insights. So what measures can we use to show that we are getting better at it.
- Delivery: We want to streamline our delivery and get faster. To do that we will automate and simplify the process wherever possible.
- Operations: The idea has moved from control to react, as operations deals with a more and more complex architecture. So we should measure our ability to react quickly and effectively.
- Architecture: Many businesses are struggling with their highly monolithic architectures or with their legacy platforms. Large scale replacements are expensive, so evolution is preferred. We need some measures to show our progress in that evolution.
With that in mind here is a sample scorecard design:

I think with these 4 areas we can drive and govern a transformation successfully. The actual metrics used will a) depend on the company you are working in and b) evolve over time as you find specific problems to solve. But having an eye on all 4 areas will make sure we are not forgetting anything important and we notice when we over optimize in one area and something else drops.
Next time I get the chance I will use a scorecard like this, of course implemented in a dashboarding tool so that it’s real time.
Leave a Comment
More Like This
Harnessing AI for Complex Systems: A New Paradigm for Industrial DevOps
Organizations building complex cyber-physical systems face mounting pressure to innovate faster while maintaining reliability,…
Beyond the Hype: The Real Business Impact of Generative AI in the Enterprise
There’s no denying that generative AI stands out as perhaps the most transformative force…
Delivering DUFFER: Essential Lessons for Defense Acquisition Success
The path from concept to deployment of military capabilities remains fraught with challenges. A…
Spring 2025 Enterprise Technology Leadership Journal: Navigating Complexity Through Innovation
We are thrilled to announce the publication of the Spring 2025 volume of the…
No comments found