This post is adapted from Chapter 4 of Flock Not Clock.
We must sound a cautionary note on evaluating whether capacity and mission align. Systems and management scientist Stafford Beer developed an important and popular systems thinking heuristic known by the acronym POSIWID: “The purpose of a system is what it does.” Beer regarded POSIWID as “bald fact” and a better starting point for understanding a system than a focus on designers’ or users’ intention or expectations. When assessing alignment, we need to focus on what the system actually does rather than its ostensible, original, or ideal purpose (since these often do not match).
POSIWID has other important implications. It means that we need to think differently about how much control we really have over complex systems. Where capacity systems consist of many subsystems integrated into a system of systems, we want to look at them individually and collectively and ask:
In Activity 4.2, you can see the value of POSIWID thinking. It flips the system and its purpose on its head. Instead of looking at the results of a system as problematic, you look at the results of the system as designed or by design. The worse the result, the more clear the value of POSIWID thinking. Take, for example, a company that is bleeding cash: you might look at this as a problem (and of course it is), but for a moment consider that everything about that company—all of its internal systems—are actually really good at spending money. This flips the problem on its head. We can now look for processes, cultural morays, and other parts of the system that are good at burning cash. Recasting the system’s purpose as POSIWID recasts the problem you are trying to solve.
Instead of the system being badly designed to serve a good outcome, it is brilliantly designed at bringing about a bad outcome. One way to determine whether a system stated purpose is also its actual purpose (which should be mission) is to measure or assess its effectiveness.
Remember what Einstein said: “Not everything that is measured matters and not everything that can be measured, matters.” Don’t measure everything about a system, measure what matters. What matters in capacity systems? This is simple: how much capacity do they produce to do your mission? That’s it. That’s all that matters in these systems. Do they contribute to making your mission happen? As such, capacity assessment is a mission-critical system within all organizations.
As an uncommitted student in his early 20s at the University of Oregon, Derek was swept up in the regional conflict either endearingly or pejoratively (depending on which side you were on) represented by the spotted owl. Loggers and the logging industry were pitted against environmentalists and (literally) tree huggers. One side wanted the industry jobs and natural resources that resulted from clear cutting the old growth of Oregon’s lush forests, while the other side wanted the ecological and recreational conservation of those same lush forests. The spotted owl really wasn’t the issue, but it was an indicator species. Scientists had determined that the size of the spotted owl population was an indicator of the larger health of the forest ecosystem. By maintaining an ongoing count of owls in the forest, scientists were measuring its health.Thus was born the “poster owl” for a movement to protect the forests.
One of the keys to monitoring capacity is to find the right “indicator species” to help you quickly measure the health of your systems, which is determined by a single outcome: whether systems are providing capacity for you to do your mission. Of course, there are often different indicators for each system, as well as the system of systems as a whole. But before you go on a hunt for low-hanging indicators, remember that you must find a way to measure what matters. We are awash in information. But one of the keenest insights from the field of research methodology is “just because you can [collect data] doesn’t mean you should.” Despite the current fixation with big data, having a lot of data isn’t in itself important. Having the right data is important. Measure what matters.
Here’s another way in which measurement is deceptively tricky. Often the ability to quantitatively measure something comes from the capacity to qualitatively understand it. This means that simply counting the things you can count isn’t enough.
Better to understand the things you want to measure (in science this is called construct validity) and learn, over time, to measure them.
Let’s examine, for example, customer satisfaction. What is customer satisfaction? You might say that the degree to which folks continue to buy your product is a good indicator of customer satisfaction. Yet we’ve continued to subscribe to the cable company’s service for our home for years. However, every time we see that there’s an emerging product on the horizon that might replace our dependence on cable, we get giddy. The second that product is viable, we'll toss cable like a used Kleenex. Until then, we’ll continue our subscription, but are we really satisfied? A better but somewhat more difficult measurement to assess is how much we rave about a particular company, service, or product.
The point is to think of metrics as measurements that are ever evolving to capture reality. And, most important, remember that ability to understand a thing qualitatively must precede attempts to measure it quantitatively. You have to figure out which indicator you need to be assessing and how might you go about measuring it.
This is just one of the "Sacred Cows" of Systems Thinking. Click the link to see all all sacred cows and their scientifically valid replacements.