Latest / Success Story with Scott Clary / Lessons - Why You Can't Learn From Your Mistakes (Hindsight Bias)
Transcript
- 0:00Welcome to Lessons Episodes of Success Story, part of the HubSpot Podcast Network.
- 0:14These lessons episodes will be shorter conversations with past guests, valued members of the success
- 0:21story community, and myself.
- 0:23They'll be focused on teaching you actionable, insightful takeaways that you can use to
- 0:28upskill your personal and professional life.
- 0:31This is the number one reason why you can't learn from your mistakes.
- 0:35It's hindsight bias.
- 0:36Let's start with a story to paint a picture.
- 0:39The year is 2005, after dating your partner or your spouse for two years, you finally
- 0:44popped a question for marriage.
- 0:46All signs point towards a lifetime of happiness together.
- 0:50But you flash forward to 2008, you've been divorced for months.
- 0:54You're going to look back and you're going to tell all your friends, even in 2023, you're
- 1:00going to tell all your friends that it is so easy to reimagine the path that led you
- 1:06here.
- 1:07You recall all the red flag that your relationship with doomed from the start.
- 1:12And you can say things like, we clearly weren't right for each other, I knew deep down
- 1:17it would end.
- 1:18But in the moment, when you were proposing to that person, the future was way less certain.
- 1:26But at the time of the proposal, divorce was never on the table, it was unfathomable.
- 1:34But fast forward, how could you not see the red flags?
- 1:38This is hindsight bias in action.
- 1:41And according to psychologists, it distorts our memory far more than we realize.
- 1:48Here's an experiment.
- 1:50In 1975, the psychologist Baruch Fischoff published a study where he asked participants to
- 1:58estimate the likelihood of various outcomes for known historical events.
- 2:05And the participants routinely estimated the actual outcomes as being over three times
- 2:12more likely than the objective measures suggested they were at the time.
- 2:18And then to double down on this and to make sure that there was a bias here, he then gave
- 2:23people short basic accounts of historical events like the Vietnam War with fictional potential
- 2:31outcomes.
- 2:32So he said things like after the Vietnam War, there was a long protracted war that ensued
- 2:38or during the Vietnam War, there was a swift resolution within a few months or there
- 2:43was a troop withdrawal and then there was a stalemate or there was nuclear weapons
- 2:47used in the Vietnam War.
- 2:50Across the board, people routinely overestimated how likely the given outcome was when they were
- 2:56told it occurred.
- 2:57And the results are crystal clear.
- 3:00Since we as humans know the finale, we can't help but feel that we saw it coming all along,
- 3:06even if the finale never happened.
- 3:09Hindsight bias gives us what's called an illusion of predictability.
- 3:14We assume we should have known it was going to happen all along.
- 3:18And we see this distortion play out frequently.
- 3:22So investors kicking themselves for not betting on the obvious, say that in air quotes,
- 3:28NX, stock, doctors who feel like a tricky diagnosis should have been clear based on
- 3:34the symptoms and maybe their peers are just idiots, historians that we've events into
- 3:39an inevitable narrative and outcome or sports coaches that take credit for brilliant coaching
- 3:46decisions even if they were just luck.
- 3:49But if we were in any of the original moments, when we had the option to make the decision
- 3:55that these people should have made, in most cases, there was no real way to know what
- 4:02we should have done.
- 4:03There are too many variables and unknowns.
- 4:05Now like all things that are modern and wise and insightful, a lot of them have been discovered
- 4:12for thousands of years.
- 4:15Hindsight bias is no difference.
- 4:16It was noticed by philosophers way, way, way back even without the official name.
- 4:21So the Roman philosopher, Seneca, he warned us that we suffer more from imagination than
- 4:28from reality.
- 4:29The imagined clarity of Hindsight bias fits this narrative perfectly.
- 4:34Confucius taught students that things that are done don't talk about, but things that
- 4:40are passed don't blame.
- 4:41But when we're calling the past, we talk and blame a lot.
- 4:45And then Buddhism's idea of the beginner's mind means approaching things without assumption
- 4:52to see clearly Hindsight bias pollutes our mind with the opposite narratives that distort
- 4:57reality.
- 4:58And modern psychology has made these intuitions into formal theories which are precursors
- 5:04to Hindsight bias like confirmation bias, memory reconstruction and cognitive dissonance,
- 5:10which I'll explain about in a second.
- 5:12So as both ancient wisdom and current science show, the future holds more uncertainty than
- 5:19our memories say.
- 5:20The confidence we place in Hindsight proves predictability is an illusion.
- 5:25And it's one that humanity keeps falling for.
- 5:28Let's look at some of the cognitive underpinnings of Hindsight bias.
- 5:32It arrives from normal functions of human cognition and memory.
- 5:37So Hindsight bias, it's wired into how our minds work.
- 5:42Studies have uncovered key processes that steer us towards these distorted Hindsight biases.
- 5:48So there's memory reconstruction.
- 5:51As humans, we don't record and replay memories like video recordings.
- 5:55We actively reconstruct them each time from whatever information is available.
- 6:01The reconstruction process of our memories, at least our memories open to huge changes,
- 6:07errors, biases.
- 6:09In one study, the psychologist Daniel Shafter showed participants a list of words that
- 6:13all related to a common theme but did not actually contain the theme word itself.
- 6:18Just words associated with it.
- 6:20Later, when he was asking the participants to recall the list, people wrongly, quote unquote,
- 6:26remembered the missing theme word being included due to associating it so strongly with the other
- 6:33words.
- 6:34It's just one example of how we artificially reconstruct memories.
- 6:38Cognitive dissonance is another theory that applies to Hindsight bias.
- 6:43So when our actions and beliefs don't line up with our desired self-image and values,
- 6:49it causes mental discomfort known as cognitive dissonance.
- 6:53Now to reduce this discomfort, we subconsciously rewrite our memories of the situation to
- 6:59make our actions seem more aligned with our self-image.
- 7:04So if we do something that we didn't like, we sort of make up our own history because
- 7:09we wanted to fit what we would have done because we want to feel good about ourselves.
- 7:13So another study, psychologist, Leon Festinger.
- 7:17He ran an experiment where he had participants perform a really boring, tedious task for
- 7:23an hour in exchange for a payment of either $1 or $20.
- 7:27Afterwards, the $1 per hour group actually rated the task as more interesting and engaging
- 7:34than the $20 per hour group did.
- 7:37The $1 group rewrote their memory of the task as less boring in order to make their cheap
- 7:43compensation better fit their negative experience because they suffered cognitive dissonance.
- 7:50They didn't want to admit in their head.
- 7:52They did a boring thing for no money.
- 7:54So the very wiring of human memory leaves it full of potential for Hindsight bias.
- 8:01The future is cloudy, but it's funny because Hindsight always seems 2020, even though
- 8:07it's not.
- 8:08And Hindsight bias is a very real problem.
- 8:11It plagues major societal institutions in the legal system.
- 8:15Studies show Hindsight bias affects judgments.
- 8:18People, so the courts, judges, jury, they see harmful events as more foreseeable and preventable
- 8:25when they know the negative outcome of that event.
- 8:29In organizations, in businesses, leaders evaluate past decisions differently based on results.
- 8:34So strategies that were seen as successes were, you know, these guaranteed winners all
- 8:38along and failures were doomed from the start despite there was a massive amount of uncertainty
- 8:43at the time and there was potentially no way to really tell if something was going to
- 8:48be a success or a failure.
- 8:49See across society, narratives formed that overemphasize the inevitability of past events.
- 8:57With Hindsight bias, we see things like financial crises, political upsets, social changes
- 9:01as pre-ordained.
- 9:03And the downstream effects of this bias are super concerning.
- 9:06It promotes massive amounts of overconfidence in predicting complex events and it allows
- 9:11poor decisions made under uncertainty to be rationalized and it also inhibits learning
- 9:18from our mistakes.
- 9:19On a personal level, Hindsight bias prevents growth by making all of our choices seem
- 9:24predestined.
- 9:26On a societal level, it entrenches all these polarized narratives that really resist compromise.
- 9:31So by recognizing our shared Hindsight biases, we can approach our future and society's
- 9:37future with more humility and openness.
- 9:41There are simply too many variables and unknowns to ever be 100% certain of what lies ahead.
- 9:49Here's a story.
- 9:50Imagine you're the coach of a football team and you have to make a crucial decision in
- 9:54the final seconds of the game.
- 9:56You have two options.
- 9:57On the ball, throw pass.
- 9:58Which one do you choose?
- 10:00And you may think that the answer depends on the outcome, right?
- 10:03If you run the ball in score, you made the right decision.
- 10:06If you throw pass and it gets intercepted, well, you made a bad decision.
- 10:09But this is not true.
- 10:10See, the outcome is not the only thing that matters.
- 10:14The process is also important.
- 10:16You have to consider the probabilities and the information you have at the time.
- 10:21You have to weigh the risks and rewards of each option.
- 10:24And you have to make the best decision you can with the facts that you have.
- 10:28See, the football scenario is not a hypothetical situation, but a real one that happened in
- 10:33Super Bowl 49 between the Seattle Seahawks and New England Patriots.
- 10:37Now this is one of my favorite examples that I found in the book thinking in bets by
- 10:41Annie Duke.
- 10:42The Seahawks coach Pete Carroll decided to throw pass in the final seconds of the game instead
- 10:46of running the ball.
- 10:47The pass was intercepted by Malcolm Butler and the Seahawks lost the game.
- 10:51Now, many people criticized Carroll's decision as the worst in Super Bowl history and blamed
- 10:58him for the outcome.
- 10:59But was it really a bad decision?
- 11:01It actually wasn't.
- 11:03See, it was a reasonable decision based on the probabilities and the information that
- 11:07he had at the time.
- 11:09According to a study by Brian Burke, there was actually a study done on this particular
- 11:13play.
- 11:14Throwing a pass in that situation had a slightly higher chance of winning than running
- 11:19the ball.
- 11:20Moreover, throwing a pass had a lower risk of losing time or being stopped by the defense.
- 11:25The interception was a rare and unlucky event, not an inevitable one.
- 11:30Judging Carroll's decision by its outcome is an example of resulting in hindsight bias.
- 11:37It's unfair and irrational to blame him for something that was beyond his control.
- 11:41It's also unproductive and unhelpful to learn from this kind of feedback.
- 11:46To avoid resulting in hindsight bias, we have to focus on the process, not the outcome.
- 11:53What we can actually do, I'll get into some more very tactical things later.
- 11:58We can ask ourselves questions when we review our past mistakes.
- 12:04I guess our past decisions, some of the mistakes, some of them not.
- 12:08What information did I have when I made the decision?
- 12:11What alternatives did I consider?
- 12:12What assumptions did I make?
- 12:13What criteria did I use to evaluate the options, how confident it was on my decision?
- 12:18What feedback did I get after the decision?
- 12:20These questions can help us assess the quality of our decision making process and then we
- 12:26identify areas for improvement.
- 12:28They can also help us separate skill from luck and recognize when we were right or wrong
- 12:33for the right or wrong reasons.
- 12:36When we do this, we can improve our thinking, make smarter decisions when we don't have
- 12:41all the facts.
- 12:42Now, although hindsight bias is ingrained in our minds, there is some research and there's
- 12:48some strategy that shows us how we can counteract it.
- 12:52We leverage wisdom from philosophy, process and psychology and let's draw some inspiration
- 12:58from some major players that proactively have to deal with it.
- 13:01So the United States Army, they do something called a pre-mortem analysis.
- 13:05So groups in the Army imagine all these potential failure options to identify flaws in the
- 13:12decision before they make a commitment to the strategy.
- 13:15Google incentivizes effective processes over outcomes and they reward decision quality
- 13:22itself rather than the resulting success and this prevents distorted evaluations and post-mortems.
- 13:30NASA promotes psychological safety and encourages open discussions of failures and it reduces
- 13:36defensive hindsight distortions because you're going to have all these different opinions
- 13:40coming in.
- 13:41The British intelligence agencies convene an accountable task force which is an outside
- 13:48unbiased group of experts that review operations and it really counters any personal hindsight
- 13:55biases or agendas and a last example would be award winning journalists.
- 14:01They mandate fact checking or they really should and they verify memories against their
- 14:06documented records to help control biases.
- 14:10Now you'll notice a common theme and obsession with recording the true conditions, data, facts,
- 14:17in the moment a decision is being made to counter the brain's natural tendencies to create
- 14:23alternate realities and facts with biased historical data.
- 14:28Now on a micro scale you're wondering how do I remove hindsight bias from my own life?
- 14:33Well here's some strategies that I use and hopefully you can use as well.
- 14:37So one strategy is to envision multiple histories when you evaluate the past.
- 14:44You have to fully immerse yourself in how events could have unfurled and come about differently.
- 14:50So you think through all these different possible outcomes.
- 14:53A lot of philosophers do this to counter overly simplistic narratives.
- 14:59Another thing you should always do in life is to cultivate a beginner's mindset.
- 15:03You can do this through meditation.
- 15:06There's certain exercises that can help you with your clarity of thought and your ability
- 15:09to approach a situation with a beginner's mindset.
- 15:12But basically you go into a situation getting rid of all assumptions and you have to see
- 15:19the situation in its reality in its clarity in the moment.
- 15:24So you remove all these preconceived notions going into a situation and you just focus on
- 15:28what you're observing, what you're seeing, what you're witnessing.
- 15:31You can focus on your decision making process.
- 15:35So you're vetting all the alternatives, all the information, you're weighing all the
- 15:40information so that you do make the best possible decision in the moment with all the pieces
- 15:46of information that you have access to.
- 15:48You can also reframe disappointments as growth opportunities.
- 15:52So say you made a bad decision in the past.
- 15:54Instead of just saying, oh my god, I should have known, you're using it as fuel for learning.
- 15:59So you're not letting that become a wasted opportunity.
- 16:03You're actually letting it be this educational moment where you can now expand your skills cut,
- 16:08your wisdom, your decision making process so that hopefully you don't make the same mistake again.
- 16:14You can also record your thoughts and your decisions daily.
- 16:18Obviously it's hard to do this with everything, but with major decisions, work, family,
- 16:25relationship, health, wellness, record your thoughts and facts available on major life-altering
- 16:32decisions so that you ground your memories in documented facts, not just biased recall.
- 16:40Journalists do this all the time to defeat distortion.
- 16:43And lastly, you should surround yourself with mentors, peers, friends, family that can
- 16:49challenge your assumptions and provide external perspective both during a decision making process,
- 16:56as well as after a decision may have knock on so well, I bet you your closest friends,
- 17:02peers, mentors can pinpoint exactly why it didn't go well and maybe you do know internally
- 17:08but you just don't want to admit it.
- 17:13And then lastly, you have to really, really rigorously assess decisions on the process.
- 17:20So where choices thoroughly vetted was data appropriately weighted, you have to ask the
- 17:25hard questions.
- 17:26There's actually a concept that I refer to as behind-site horizon when you're thinking
- 17:32about this bias.
- 17:34So the idea is that we each have a horizon dictating how far we can objectively see
- 17:41into the past.
- 17:43And there's things that limit our horizon, that are fixed so our cognitive wiring are
- 17:48the culture that were born into other uncontrollable events, but much of our hindsight horizon
- 17:55is within our control.
- 17:57So when we do some of the things that I just mentioned, our habits and our behaviors
- 18:02or lack thereof can cloud our horizon which will obscure the past behind bias.
- 18:09Or if we action some of the things that I just brought up, they can't expand our horizon,
- 18:15bringing objectivity into clearer view.
- 18:18And those that are overcoming hindsight bias regularly and learning from their mistakes,
- 18:24they really grasp this.
- 18:26They question their assumptions when recalling the past and they focus on sound decision
- 18:33processes over the results.
- 18:35They view failures as chances to widen their horizon and in essence, they've engineered
- 18:41an expansive hindsight horizon and their view of the past can now be more objective and
- 18:48accurate.
- 18:49So your really your goal is to in the context of this horizon, this hindsight horizon,
- 18:55you want to reduce fog, you want to watch for ego, dogma, pessimism, anything clouding
- 19:01this unbiased inquiry and then you want to amplify clarity, you want to seek diverse
- 19:06views, you want to document facts, you want to reward good processes, anything bringing
- 19:11objectivity into focus.
- 19:12Remember, with the hindsight bias and the hindsight horizon rule that you can use when battling
- 19:19hindsight bias, if you're trying to choose a path in your day to day and your habits
- 19:25and your processes, take the one that offers the clearest view of the path.
- 19:30Ask yourself, where is my vision most objective and head there, it'll allow you to learn from
- 19:38the past and make better decisions for the future.