Book review: The Halo Effect
Luca -
☕ 3 min. read
When I read Built to Last, In search of excellent and Good to great I immediately thought: What a bunch of BS!!. But again, I think that about most business books.
The content of these books seemed particularly ludicrous to me. I found both logical inconsistencies and methodological flaws in their process. For example, picking successful companies after the fact is analogous to picking the winners of a lottery and claim that they have exceptional skills. Betting the farm on a single concept (i.e. Big Hairy Goal) is clearly the right thing when you are right, but most often than not you are wrong. What about all the companies that did that and failed? Also, Keeping to the Core worked really well for Coca Cola, but really badly for Kodak.
These are just examples. These books are packed full of such reasonably sounding absurdities. I thought that everybody would immediately spot this. I thought that the mediocre subsequent performance of the companies originally selected as excellent would obviously demonstrate the unsoundness of such conclusion. I was very wrong. These tomes are hugely successful. People seemed to disagree with me. They really like this stuff. Given that my work and my life were not overly impacted one way or the other, I left the matter to rest.
And then came The Halo Effect. It was a pleasure for me to read, as it confirmed my own ideas (confirmation bias anyone?) and added many more.
The title is slightly misleading. A better title would have been: Why the idea of finding common traits among successful companies is baloney. I know, not as catchy. The catchy halo effect, mentioned in the title, is just the biggest delusion that people have about the topic.
I found an experiment recounted in the book to be very illuminating. They divided a set of people in multiple groups and gave each group a problem to solve. They then told half of the groups that they did a very good job and the other half that they did a very poor job. The thing is, they did so at random. They then asked people to rate the dynamics of their group on several factors. People that were told that they did a good job reported to have had wonderful dynamics: open discussions, inspired leaders, high caliber people and such. The opposite was true for the other groups.
It didn’t matter what the actual dynamics had really been: some groups were very confrontational, others were very amicable; some were very vocal, others were very quiet. In the end, people who were told that they did good recalled the experience in positive terms. People who were told that they did poorly, recalled the experience in negative terms. Remember, good and bad outcomes were assigned randomly. Also, the results have been confirmed in several similar studies.
It is not a good strategy that drives performance. It is perceived performance that makes people think that they had a good strategy. This is: The halo effect. This simple concept has dramatic repercussions.
First of all, it invalidates the main process used in these studies: if you use newspapers articles and managers recollection to draw conclusions, you are just piling halos over halos. People would certainly give all sort of positive attributes to companies that succeeded. They do it exactly because they succeeded. And when these companies fail, they suddenly give all sort of negative attributes to them. The book is full of examples of companies that were rated as excellent when their stock price went up and terrible when their stock price went down. Nothing changed in these companies, they were still doing the same exact thing.
The book contains many other insights of why these ‘studies’ are deeply flawed. It calls them delusions. You are probably familiar with some of them if you have a scientific background: for example, Delusion of Correlation and Causality, Delusion of Single Explanation (factors are not independent), Delusion of Connecting the Winning Dots (ad hoc after the fact selection). Other delusions are specific to the analyzed domain: Delusion of Lasting Success, Delusion of Absolute Performance, Delusion of Organizational Physics.
In the end what should managers do? Instead of following these books’s precepts, they should focus on two things: strategy and execution. Both of these things are probabilistic endeavors where the absolutely wrong measuring stick is the result that you obtain. I always found this to be a very common error people fall into at whatever level in an organization. The error is judging the soundness of a decision by its result. A decision should be judged by the soundness of the process to get to the decision and the information available at the time the decision was taken. This is the only thing that is consistent with the probabilistic nature of the world we live in. The book profiles three leaders who embody this probabilistic view.
In summary, please go and read this book. There are many more things in it than I described in this (albeit long and boring) post.
0 Webmentions
These are webmentions via the IndieWeb and webmention.io.
5 Comments
Comments
wintermute
2008-01-11T17:50:41ZThe process to get the decision and data available at the time of the decision are of course of paramount importance. I agree on that. What I do not agree is that we should not rate the result of the decision to judge it. After all if the process is sound but the decision we take leads to an unwanted result then the shareholders will not be happy about that. In other words, if I had to bet my money I would bet it on someone that is lucky. Lucky as Warren Buffet. I would not bet it with somebody with a good process like Myron Scholes.
lucabol
2008-01-11T20:04:22ZI disagree. You can bet on the lucky one just after the fact, and at that point he might become unlucky.
BTW: Buffett has a better process than Scholes because it is more tied to reality (assuming that by Scholes you mean the efficient market theorists).
Dolly Photon
2008-01-25T04:36:18Z"The error is judging the soundness of a decision by its result" - you can't possibly mean that! Otherwise it would be impossible to learn from experience. Where else does our knowledge of the the "soundness" of our processes and information come from?
lucabol
2008-01-25T11:52:30ZExcellent point !!!
Experience is a series of experiments with an initial state, an action and an outcome. It is the data base that helps us to form our opinion that given an initial state (i) and an action (a1) there is a certain probability (p1) that I obtain a particular outcome (o1).
The observed result of a decision is just a modification of the probability associated with that initial-state/action pair. It just changes your opinion of p1, often not by a large amount given that it is just one instance.
In this mental framework, you don't judge the soundness of a decision by the result, you just change the associated probability when you observe a certain result.
This is not how people think, because our minds are evolutionary wired for cause/effects relationships (i.e. I see a tiger, I better run). Nonetheless I argue it is a better framework to cope with the current world (given the observed scarcity of tigers :) ).
Weddings
2008-06-06T05:26:30ZWhen I read " Built to Last ", " In search of excellent " and " Good to great " I immediately thought: "What a bunch of BS!!". But again, I think that about most business books. The content of these books seemed