Continuing the pattern from my past few post on Antifragile concepts, today consider Naive Intervention, that idea assuming that simple model actually represents a complex system can lead to disastrously bad decisions.
This subject was covered adequately by Max Pucher in his three part series: (1) From Antifragile to Models Behaving Badly, (2) It is a Matter of Survival, not Efficiency, and (3) Illusions of Predictability in Investment Theory and BPM. I will just give a short summary here.
The entire discussion is rooted in complexity theory: systems can be complex. The overwhelming need to come up with a narrative to explain what is happening in such a system, drives people to use models as a way of explaining what is going on.
Emanuel Derman’s book ‘Models Behaving Badly – Why Confusing Illusion with Reality Can Lead to Disaster, on Wall Street and in Life‘ goes into a lot of detail about the distinction between a scientific law, a theory, and a model — concepts that most of us blur in everyday life. A model is an illusion, and it is not reality. Most of the book explains how financial models are essentially fictions about a complex system yielding very inaccurate and largely untested predictions. They serve a purpose in allowing us to understand some aspects of the behavior of the financial market, but confusing these this illusions with reality can lead to disaster. Models are not theories, like the Dirac theory of an electron, which is able to yield results that are accurate to more than 10 digits of precision. A model can be helpful in understanding some behavior, but can also be completely incorrect when the situation is outside of certain parameters. No financial model can reliably predict the closing price of AAPL stock one week from today — not even to one digit accuracy!
The warning is apt in the work management field because human organizations are complex systems, just like financial markets. Many of the models that describe how people work are just as fictional as the financial models. For example, the fundamental assumption behind most economic models is that people will decide to do thing (e.g. go to a Broadway show) based on a cost vs. benefit analysis of all the factors. Real life is both much more complex than that, and at the same time often much more basic. We know that success in most important jobs depends upon something we call caring, and yet we have no measure for the amount of caring that person bring to the job.
In BPM we work with models as well, but success depends upon what you are modeling. If you have a model of how you are going to on-board a new telephone account holder, then you have more or less complete freedom on how to do this. It is a routine, straight-through process, and a model works adequately. But if your model is about how human patients, or public opinion, or social work situations, then watch out. In these complex situations they simplify too much and bring about naive intervention.
The problem appears when we make decisions based on those simplified models. There may be a satisfying narrative about why a particular change might improve productivity, but never forget that it is just based on a model. Taleb, in the book Antifragile points out that some of the best traders knew nothing about the commodities they traded: they only know the prices and the pattern of exchanges. We like to think that we are not being naive by basing actions on a model, but we do this, as Max points out, because it gives us a feeling of control. We demand that the risks we take are calculable. But what if they are not? What if there is no model that accurately represents the complex system! We abhor that thought. Max says:
As long as we believe we can calculate the risks of complex systems we are continuously increasing the risk of that total collapse.
More than that, we often are led to to the simplistic assumption that if something is wrong, it should be a single thing that is wrong:
We need to re-learn that in a complex world the notion of a single logical cause or a predictable outcome of an action is suspect. The constant, random stress is information that aligns the small anti-fragile system with the changes in its environment.
It would be time to stop being so arrogant in pretending that we know it all and have it all under control. We obviously do not!
Naive interventionism is that mode of behavior where response is dictated by a formula, but that formula is based on a simplistic model. Before introducing such a formula, the organization may seem chaotic, and makes a lot of random mistakes. But after instituting the formula, it avoids a lot of common predictable mistakes, but it also enshrines a lot of less common but still predictable mistakes. More importantly, adoption of the formula exposes the organization to an even greater risk:
As you make your business more efficient and more stable (by for example using BPM or outsourcing) you are unavoidably reducing its resilience by not being able to react continuously to changing external events.
This is the unintended consequence of formalizing the unformalizable.
Barry Schwartz talks about it as loss of wisdom. His story is about a child traumatized by a being forcefully removed from his parents for two weeks because of a tiny and forgivable mistake the dad made. Every person involved in the enforcement said it was a shame and completely unjustified, however the laws were clear that they were required to follow. Naive interventionism can be seen in this attempt to replace wisdom with a set of formal rules.
We get, once again, to the surprising quality of a complex adaptive system, that it needs a certain amount of stressing.
In a complex adaptive system constant stress is not to be mistaken as overreacting to noise but must be understood as environmental tuning information.
We need to re-learn that in a complex world the notion of a single logical cause or a predictable outcome of an action is suspect. The constant, random stress is information that aligns the small anti-fragile system with the changes in its environment
This really should not be surprising. If you want a football team to play well in the finals, you don’t spend all the time sitting around the table drawing pictures and precisely calculating distances and speed necessary to win. You don’t save all the energy you can to expend it all in a single final game. Instead, you send them out to play many many practice games. These practice games are not a waste of energy, but necessary to learn. Teams sports are a complex activity. It is the exercise of the team that makes the team learn. By experiencing a wide variety of situations, the players themselves learn how best to situate themselves. Emergency response teams do drills and exercises to increase their effectiveness.
Why should business management be any different? Practice makes the learning organization effective.
The most important thing is to accept that most of the real decisions and behaviors of a large organization are unknown. Instead of insisting that all such decisions be exposed or subsumed by a model, it might be better to let the experts do their jobs. Exercise the organization, measure the total output, but let the individuals figure out how to contribute the best. Avoid micromanagement via naive intervention.
I wonder what Wolfram would think of this. He recently posited that surprisingly simple equations might represent the known universe (in other words, there is a sense of convergent math, where what appears to be complex has simple underpinnings). A combination of simple models can have very complex results.
Yes, I was mindful of this as well, and admit I can’t quite nail down the precise difference. What he shows is that very simple iterative patterns can produce surprisingly complex patterns. For example, the simple rules about water molecules bouncing off each other can produce the phenomena of waves crashing on the beach. It is simple rules, but it is large numbers of them all interacting over and over. There is something very different about our attempts to break complex systems into meaningful parts. I think the problem is related that use of the term “meaningful”. It is the attempt describe one wave as separate from other waves that we run into problems. You will notice that when Wolfram produces complexity, that complexity is related to everything else. There is no ability to break the output into parts that are themselves simpler than the overall thing. The net is: there may in fact be fundamentally simple rules that guide human behaviors, but we have no awareness of them, and they certainly are not going to be the kinds of things you see in a BPM diagram.
I think the other point in wolfram’s work however, is that models are useful. it doesn’t mean they’re infallible, but they’re useful. too often people start thinking BPM diagrams and all other formalisms are not useful -but they are. Its easy to grab onto the argument that says anarchy is best – the easy path is the best path. A bit like the agile vs. waterfall arguments – some people grab onto agile as a way to avoid work, rather than as a way to focus on the right work.
just watched a talk by wolfram at SXSW this year and he was pretty fantastic, as usual.
Hi Scott, unfortunately that perspective represent a misunderstanding of the laws of nature. I know Wolframs perspective well and he is most probably right, but as we can see in quantum physics, all outcomes have just some probabilty – disregarding how simple the formulae may be – therefore there is no predicting of outcomes. If there is a complex interaction of outcomes, the sum of all at some time in the future is utterly unpredictable so there is a probability that a range of outcomes is more likely than others. The simplicity of formuale is not only found in Kabala (Jewish Mythology) but also int he Golden Mean, and the Fibonacci Series one being and the other converging to PHI. Fractal mathematics as discovered by Benoit Mandelbrot allow us to calculate natural structures with convincing quality. There would be no movies made today without the computer graphics that use these formulae.
But because nature is not static, but dynamic and because there is not causal, directional interaction, but just interaction, meaning a cause is also a consequence and vice versa and always acts in both directions, there is no mathematical model that can be used to calculate any future in any complex adaptive system. Action and reaction are one as both the hammer and the nail is deformed as are the pieces of wood that are nailed together. The air is sent out as a shockwave, the wood vibrates and the new nail connection of the two beams no creates a new tension distribution in their structure. The human reacts to all of those not in a mathematical predictable way but we assume it is all totally natural that we can peform that act and make it work as expected. It is intuition, practice and predisposed ability in our genes that allows us to be a craftsman and not some mathematical model of how all these things work together. Nature does not need narrative I wrote, just we humans do. It is a grand fallacy to assume that the narrative actually is the world that we see. And mathematical models are just such narratives.
Pingback: Naive Intervention makes Poor Process Design | Collaborative ... | Performance Management and Process Design | Scoop.it
Twenty-two Ming memories, next. wwW, like ring is really what’s going on weeping children. He angrily not a sentence Emirates! This Zhu Biao child, do not know how many people are offended, we regarded by him into trouble, but fortunately, we run fast, or else trouble so much movement, not locked up by the police blockade message when pigs fly, I’ll give him a call. Followed he suffered a dragged this thing he will give an explanation.
This is a great article about how simple models of business processes can lead to disastrously bad decisions.
If an operations manager were to pursue a culture of continuous business process improvement, there could be many potential benefits – improved order entry, improved claims processing, and improved customer service. Additionally, any complications could be accounted for and prevented. In fact, over 30% of invoices are disputed by customers due to poor documentation by the sales group, e.g., to payment terms, pricing, shortage allowances, deduction policies and payment discounts. Roughly 20% of these invoices were still unresolved after 120 days.
Most operations managers who want end-to-end order management business process flows of their order management processes will have to convince executives to bring in expensive consultants and their expensive resources. Luckily, for operations managers who can’t make executive level decisions, there are some resources available. This free online source provides order management business process flow templates, benchmarks, best practices and improvement opportunities: http://opsdog.com/improvement/ordermanagement/processmaps