Latest / Trumponomics / Silencing the ‘Noise’ Behind Bad Corporate Decisionmaking

Transcript

Silencing the ‘Noise’ Behind Bad Corporate Decisionmaking · Trumponomics

0:05
Speaker 1: Hello, and welcome to Stephanomics, the podcast that brings the
0:07
Speaker 1: global economy to you. And this week we have a
0:10
Speaker 1: treat in the form of a conversation with Daniel Kannerman,
0:13
Speaker 1: the most influential and respected psychologist in the world. He's
0:17
Speaker 1: one of a small number of non economists to have
0:20
Speaker 1: won the Nobel Prize for Economics for his contribution to
0:23
Speaker 1: the school of behavioral economics. With his collaborator Amos Verski,
0:27
Speaker 1: he also wrote what I'm sure is the best selling
0:30
Speaker 1: psychology book of all time, Thinking Fast and Slow, along
0:34
Speaker 1: with Olivier Siboni and cass Sunstein. He has a new
0:37
Speaker 1: book just coming out in paperback, Noise The Flaw in
0:40
Speaker 1: Human Judgment. Olivier is a professor of Strategy and Business
0:44
Speaker 1: Policy at h GC Paris, and I'm pleased to say
0:47
Speaker 1: he joined us for the interview. But I started by
0:49
Speaker 1: asking Kannerman to tell us what this great flaw in
0:52
Speaker 1: human judgment was that he caused noise? Define uh, what
1:02
Speaker 1: noises in relation to its cousin more familiar cousin, which
1:07
Speaker 1: is biased? Uh. And we're talk in general about errors
1:12
Speaker 1: of judgment, and the context when we talk about errors
1:15
Speaker 1: of judgment is to compare judgment to measurement. That's where
1:21
Speaker 1: the whole notions of accuracy and accuracy of measurement and error.
1:26
Speaker 1: The regulous treatment of errors stems so com from the
1:31
Speaker 1: comparison of judgment to measurement. Now, in measurement, when you're
1:35
Speaker 1: measuring the same object multiple times with the very fine rulers,
1:41
Speaker 1: we're not going to get the same result every time.
1:44
Speaker 1: That is, if the ruler is fine enough, there's going
1:47
Speaker 1: to be variability. That variability, that's the variability that we
1:52
Speaker 1: call noise. So the errors some areas are positive of
1:56
Speaker 1: the errors are negative, and the variability of the air
2:00
Speaker 1: a noise. The average error is a bias, so that
2:04
Speaker 1: you can have positive bias or negative bias. And it
2:08
Speaker 1: turns out that in the discussion of errors of judgment
2:12
Speaker 1: we have focused on systematic errors on biases, and very
2:17
Speaker 1: little attention has been paid in the discussion of error
2:20
Speaker 1: and two noise to variability. But in the theory of measurements,
2:25
Speaker 1: bias and noise actually have equivalent weight, and there is
2:30
Speaker 1: reason to believe that more inaccuracy and judgment is often
2:35
Speaker 1: due to noise than to bias. And this is you
2:39
Speaker 1: know where the book came to be. And I guess
2:41
Speaker 1: it's worth saying. We're used to thinking of the bias
2:43
Speaker 1: that you'll be systematically leaning in one direction or another
2:47
Speaker 1: in the directions that we in the decisions that we take.
2:50
Speaker 1: But I guess the point of the noise is that
2:53
Speaker 1: it's not predictable. And I guess crucially we fail to
2:57
Speaker 1: understand not just that there is noise, but the stint
3:00
Speaker 1: of the noise. We ask experts something and we expect
3:03
Speaker 1: there to be only a relatively small variation in their decisions,
3:08
Speaker 1: and actually there's a huge variation. So I guess it's
3:10
Speaker 1: it's worth talking through one of those examples just to
3:13
Speaker 1: give a sense of what you're talking about. I can
3:15
Speaker 1: describe the example from what the study began, and this
3:20
Speaker 1: It began about eight years ago when I was doing
3:23
Speaker 1: some consulting in an insurance company and I conducted a
3:29
Speaker 1: fairly between experiment that today we would call a noise audit,
3:33
Speaker 1: where cases were constructed which were very common representative of
3:40
Speaker 1: the work of underwriters in that company, and then the
3:44
Speaker 1: same cases were presented to several dozen underwriters about fifty
3:48
Speaker 1: years I recall, and we looked at the variability they
3:53
Speaker 1: looked at. They put a dollar value on those cases. Now,
3:56
Speaker 1: notice those cases worth were fictions. They were constructed as such,
4:02
Speaker 1: but they were very typical. And the idea was that
4:05
Speaker 1: if underwriters vary in their judgments of those hypothetical cases,
4:10
Speaker 1: they would also vary in their judgments of real case. Now,
4:14
Speaker 1: I ask executives in the company a question that I
4:17
Speaker 1: think anybody was listening to this would also ask themselves.
4:22
Speaker 1: If you look at two underwriters and you should pick
4:26
Speaker 1: that random and our large the difference do you expect
4:30
Speaker 1: to find between them in percentages? That is, you take
4:35
Speaker 1: the two underwriters, you compute their average of their judgments
4:38
Speaker 1: the difference of their judgrens. To divide the difference by
4:41
Speaker 1: the average, what percentage do you expect most people or
4:46
Speaker 1: many people? There is a really common answer to that question.
4:50
Speaker 1: People expect about them pass and this was also true
4:55
Speaker 1: of the executives in that company. We don't expect judgments
4:58
Speaker 1: to be perfectly, but we expect them not to disagree wildly. Now,
5:05
Speaker 1: the real number that we observed in the experiment was
5:11
Speaker 1: about fifty five zero five times larger than expected, and
5:17
Speaker 1: that's really the origin of the book. So it looked
5:21
Speaker 1: worth studying, not only because there was a lot of noise,
5:26
Speaker 1: but because the noise came as complete news to the organization.
5:31
Speaker 1: They were unaware that they had a noise problem. So
5:36
Speaker 1: we started with slogan, which is and it turned out
5:40
Speaker 1: that there's a lot of noise everywhere, that wherever there
5:43
Speaker 1: is judgment, there is noise, and there is more of
5:46
Speaker 1: it than you think, and that is really the motivation
5:50
Speaker 1: for the book. Olivia joined me very soon and they
5:55
Speaker 1: started working in the book together. Cast joined us later. Um,
6:00
Speaker 1: that's the story in a year ago the book. It
6:04
Speaker 1: is interesting. You know, obviously you're from different fields and Olivia,
6:07
Speaker 1: I'm interested in you are drawn to this because obviously
6:11
Speaker 1: it has very clear relevance for business strategy and the
6:14
Speaker 1: way companies think about sort of what it is they're doing. Well.
6:17
Speaker 1: As Danny has just described it, noise is unwanted variability
6:21
Speaker 1: in judgments. And this only becomes a problem when you're
6:25
Speaker 1: an organization. Noise is a disease of organizations. If you
6:29
Speaker 1: are an individual, we will never know how noisy you are.
6:33
Speaker 1: You are noisy, by the way, and you are you
6:34
Speaker 1: are subject to the same sources of noise that we
6:37
Speaker 1: are all subject to it organizations. But where we expect
6:40
Speaker 1: consistency is when people in an organization are making judgments
6:45
Speaker 1: on behalf of the organization, as in the example of
6:48
Speaker 1: the underwriters that Danny was just talking about, and when
6:51
Speaker 1: we expect those judgments to be reasonably consistent. If you
6:54
Speaker 1: look at another example we've looked at, which is the
6:57
Speaker 1: judicial system, we expect that the decisions that judges renders
7:03
Speaker 1: should not be too dependent on the identity of the judge.
7:06
Speaker 1: Of course, again we expect some variability, but we expect
7:10
Speaker 1: general consistency. And the challenge for organizations of any kind
7:16
Speaker 1: is to actually achieve something approaching consistency, because first they
7:21
Speaker 1: need to realize how much inconsistency they have. They need
7:25
Speaker 1: to realize how much noise there is, and as then
7:27
Speaker 1: he pointed out, they're not aware of that. It comes
7:30
Speaker 1: as a complete surprise when they realize that. So it's
7:32
Speaker 1: a huge organizational problem for private enterprises, but also for administrations,
7:38
Speaker 1: for government, for non government organizations, for any organization of
7:44
Speaker 1: any kind that has many people making judgments and that
7:48
Speaker 1: expects consistency. There's so many different strands of this. I
7:51
Speaker 1: think there's one which is a straightforward sort of natural
7:54
Speaker 1: justice perspective. But some of the examples in the book,
7:57
Speaker 1: there's some of the ones that perhaps were most familiar
8:00
Speaker 1: with is the variation in sentencing for the same case
8:04
Speaker 1: depending on whether the judges football team one or lost
8:07
Speaker 1: at the weekend or whatever. It maybe. But it also
8:11
Speaker 1: raises a question about what is the nature of expertise
8:15
Speaker 1: If we like to think that an experts are experts
8:19
Speaker 1: in part because they understand the body of knowledge and
8:24
Speaker 1: have a shared understanding of that the way the world
8:27
Speaker 1: works in that particular expertise, And what a lot of
8:30
Speaker 1: these examples suggests is that they're all experts in their
8:33
Speaker 1: own way, and they're all coming up with completely different conclusions.
8:36
Speaker 1: Does want come away from this thinking that experts are
8:41
Speaker 1: not necessarily helpful for organizations. I think you've come away
8:45
Speaker 1: thinking that there are really two different sorts of experts,
8:48
Speaker 1: and that we should be clearer in our articulation of
8:50
Speaker 1: that distinction. There are experts whose track records can actually
8:55
Speaker 1: be evaluated, whose expertise can be quantified measured against a
8:59
Speaker 1: gold stand earth. So if you're a forecaster and you
9:02
Speaker 1: make short term economic forecasts, and each quarter we can
9:06
Speaker 1: check how oft you were and it turns out that
9:09
Speaker 1: your forecast historically been very good, we can say you're
9:12
Speaker 1: a true expert as forecasting. Now, if you're making thirty
9:15
Speaker 1: year forecasts, how much of an expert you are does
9:20
Speaker 1: not depend on how good your forecasts are. It depends
9:23
Speaker 1: on how much respect we accord you as a forecaster.
9:28
Speaker 1: And those are the experts that we call respect experts
9:32
Speaker 1: because they're experts, not because they have demonstrable experts ese,
9:37
Speaker 1: but because they have convinced others of their expertise, because
9:40
Speaker 1: we have respect for their expertise. That is not a
9:43
Speaker 1: criticism of those experts, by the way, because in many fields,
9:46
Speaker 1: all you can be is a respect expert. Even the
9:49
Speaker 1: underwriters that Danny was talking about, we'll never know if
9:53
Speaker 1: they've actually set the right premium for an insurance policy.
9:56
Speaker 1: So we have respect for them because they are convincing,
9:59
Speaker 1: because they can are securely their reasoning in a compelling manner,
10:02
Speaker 1: because they have experience, because they have gained confidence in
10:06
Speaker 1: the way they do their job. But they are not
10:08
Speaker 1: the same sort of experts as the experts whose expertise
10:11
Speaker 1: can be demonstrated. And what we argue in Noise is
10:14
Speaker 1: that it's important to know what sort of experts you're
10:16
Speaker 1: dealing with. When you're dealing with experts, Danny kind of.
10:26
Speaker 1: And you talk about good decision hygiene as being the
10:29
Speaker 1: sort of equivalent of washing your hands so that you
10:32
Speaker 1: can have the limited infection from noise. What what does
10:36
Speaker 1: that look like for a for a policymaker or an organization. Well, well,
10:40
Speaker 1: whole notion of the hygiene is in contrast to common
10:46
Speaker 1: efforts of the biases trying to reduce various biases in
10:52
Speaker 1: the thinking of the judgment of organizations and individuals. Uh,
10:58
Speaker 1: the bias thing is very much like medication or vaccination.
11:03
Speaker 1: It's specific to a particular disease. Hygiene, like washing your hands,
11:09
Speaker 1: is non specific. But as you don't know what germs
11:13
Speaker 1: you're killing, if you're lucky, you'll never know. And uh,
11:17
Speaker 1: that's that's the nature of hygiene. And when you think
11:22
Speaker 1: about noise, the only way that we could think of
11:25
Speaker 1: improving judgment of reducing noise is by taking steps which
11:31
Speaker 1: are generally steps to improve the quality of judgment, but
11:35
Speaker 1: are not oriented to particular biases or two combat particular biases.
11:41
Speaker 1: What would be a good example of good hygiene where
11:44
Speaker 1: you could otherwise have a very noisy and unfair decisions.
11:47
Speaker 1: A standard example, and actually an example that was very
11:50
Speaker 1: influential on our thinking, is how to conduct hiring interviews.
11:56
Speaker 1: And there has been a lot of research on hiring
11:59
Speaker 1: interviews and they fall into two broad families. Unstructured interviews,
12:06
Speaker 1: that's the common procedure where you talk to the candidate,
12:11
Speaker 1: you try to form a general impression, You have a
12:14
Speaker 1: conversation with the candidate, there is some human contact, and
12:17
Speaker 1: at the end of the process you you make a
12:20
Speaker 1: decision or you form an impression of that candid. A
12:24
Speaker 1: structured interview is very different. In a structured interview, you
12:29
Speaker 1: have a list of topics that you want to think about.
12:32
Speaker 1: For example, you want to assess various attributes of the candidate,
12:39
Speaker 1: how original, how reliable, many attributes that may be relevant
12:44
Speaker 1: to a particular job. And in a structured interview, you
12:49
Speaker 1: think about each of these areas in turn and you
12:54
Speaker 1: conduct an interview. That is, you ask questions that pertain
12:58
Speaker 1: to that particular area, actually write down a grade or
13:03
Speaker 1: ranking or rating for that before switching to the next topic.
13:08
Speaker 1: So that's a structured interview. Now it turns out that
13:12
Speaker 1: neither kind of interview is very good because because basically
13:17
Speaker 1: performance in on jobs is very difficult to predict and
13:21
Speaker 1: it doesn't depend only on the characteristics of the individual.
13:25
Speaker 1: But structured interview are distinctly superior to unstructured interview. And
13:31
Speaker 1: so structuring is we think a good idea, and when
13:35
Speaker 1: you're making a decision and you're considering various options, you
13:40
Speaker 1: might want to consider the options as if there were
13:43
Speaker 1: candidates and assess the various attributes of an option. And
13:49
Speaker 1: the important feature here that you delay the global intuition.
13:55
Speaker 1: You delay the formation of the global impression. Intuition. One
14:00
Speaker 1: of the problems of intuitive thinking that it comes very fast.
14:04
Speaker 1: They form first impressions, and in unstructured interviews, typically an
14:09
Speaker 1: impression is formed very quickly and most of the rest
14:12
Speaker 1: of the conversation is to justify the national impression. In
14:17
Speaker 1: a structured interview, that's not the case. You deal with
14:21
Speaker 1: topics one at the time and you try to delay
14:23
Speaker 1: the global view of the candidate until all the information
14:27
Speaker 1: is So that's an example of decision. But I mean,
14:31
Speaker 1: one of the points about intuition is it's not very controllable.
14:35
Speaker 1: So I'm just wondering. I mean, you know, you and
14:38
Speaker 1: Olivier and and and behavioral economists may be very aware
14:43
Speaker 1: of all the biases and all the noise that you've
14:45
Speaker 1: just talked about. But when you're sitting interviewing a candidate
14:48
Speaker 1: or a potential colleague at university or whatever, how do
14:52
Speaker 1: you actually stop yourself from having a first impression of someone,
14:56
Speaker 1: Because by definition of first impression comes unbidden. Oh, you
15:00
Speaker 1: will undoubtedly form impresference, there is no question. But but
15:06
Speaker 1: if you have a set of questions that you want
15:09
Speaker 1: to ask about the person's reliability or about the extent
15:13
Speaker 1: of their experience on similar on a similar, unsimilar task,
15:18
Speaker 1: those specific questions are going to fail your mind, and
15:22
Speaker 1: they're going to push the intuition aside to some extent,
15:26
Speaker 1: and you will have an opportunity that you normally do
15:30
Speaker 1: not have of disconfirming your initial impression, of finding things
15:35
Speaker 1: out that actually do not fit the initial impression. In general,
15:40
Speaker 1: an unstructured interview, impressions are self reinforces. You justify your
15:46
Speaker 1: initial impression, and that is a source of noise, And
15:50
Speaker 1: by structuring the process you reduce that source of noise.
15:56
Speaker 1: An additional thing you can do to limit the problem
15:59
Speaker 1: that you're pointing out Stephanie is to have different people
16:04
Speaker 1: or different sources of information evaluate the different dimensions that
16:08
Speaker 1: you are looking at. So, if you're evaluating candidates for
16:13
Speaker 1: you know, intelligence, technical skills, and fit with the culture
16:18
Speaker 1: of the company, let's assume these are the three dimensions
16:20
Speaker 1: of your job description. In an unstructured interview, you would
16:24
Speaker 1: form an overall picture of the person and you would
16:28
Speaker 1: then raid them on the three dimensions, but they would
16:30
Speaker 1: be strongly correlated with each other because there would be
16:33
Speaker 1: a positive or a negative halo around the person, and
16:36
Speaker 1: you would say they are great and everything, or they're
16:38
Speaker 1: bad on everything. Now suppose that we say you, Stephanie,
16:42
Speaker 1: are going to conduct the interview about the technical skills,
16:45
Speaker 1: or maybe in fact, we're going to have a technical
16:48
Speaker 1: test to evaluate the technical skills. Someone else is going
16:51
Speaker 1: to evaluate the fit with the company, and someone else
16:54
Speaker 1: is going to evaluate how smart the person is, or again,
16:57
Speaker 1: perhaps we're going to have the test of how smart
17:00
Speaker 1: the person is. Now you've got three independent data points
17:03
Speaker 1: that do not influence each other, and you have a
17:06
Speaker 1: much more structured process to make your decision. You would
17:09
Speaker 1: have anounced this before, but of course, a lot of
17:10
Speaker 1: people entering the job market now find that they're at
17:14
Speaker 1: least the first couple of rounds, depending on how popular
17:17
Speaker 1: the job is is, and they're talking to a computer
17:20
Speaker 1: or they have there is a an AI element to
17:24
Speaker 1: their application process. We may not like it, we may
17:28
Speaker 1: think it's not true to our great sense of intuition
17:31
Speaker 1: about people. But from a fairness perspective and from a
17:35
Speaker 1: decision hygiene perspective, is that a better way to go?
17:38
Speaker 1: We need to be careful here, because there is an
17:40
Speaker 1: answer in principle, and there is an answer in practice.
17:43
Speaker 1: In principle, any form of structured decision making that reduces
17:49
Speaker 1: noise would in fact enhance the quality of the decisions.
17:53
Speaker 1: So if you have an algorithm making decisions, there is
17:56
Speaker 1: going to be less noise there. But of course the
17:58
Speaker 1: question is how good is the algorithm? How good are
18:01
Speaker 1: those AI systems that people sit in front of, And
18:06
Speaker 1: I'm sure there are good ones, but from the ones
18:09
Speaker 1: that I've seen personally in my admittedly limited experience, there
18:14
Speaker 1: isn't much evidence, and there isn't very good quality evidence
18:19
Speaker 1: that what these software packages are testing for is actually
18:25
Speaker 1: what you're looking for. It's actually quite hard for most
18:27
Speaker 1: companies to define what it is that they're looking for,
18:30
Speaker 1: and there is no evidence that I've seen that there's
18:34
Speaker 1: any correlation between when those software packages look for and
18:39
Speaker 1: job success is actually highly correlated. So in practice I'm
18:45
Speaker 1: quite skeptical about what I see in the market. In theory,
18:51
Speaker 1: I have to agree that it makes some sense, but
18:53
Speaker 1: my worry is that companies are using this mostly to
18:56
Speaker 1: save time and money, not to actually improve the quality
18:59
Speaker 1: of their decision. Here, I would hope that what is
19:03
Speaker 1: true in theory can be made true in practice. And
19:07
Speaker 1: one characteristics of algorithms and is that they're improvable. They're
19:13
Speaker 1: much more improvable than people are, and and they can
19:17
Speaker 1: be corrected by by data on quality. They can be
19:22
Speaker 1: made to predict more accurately. So this this is really
19:26
Speaker 1: an issue of the quality of constructing algorithms. And there
19:32
Speaker 1: are many algorithms that are of poor quality out there
19:36
Speaker 1: on the market, and there is a widespread suspicion of
19:40
Speaker 1: algorithms which makes us prone to reject them. But by
19:45
Speaker 1: and large, I think this is the future. In the future,
19:50
Speaker 1: there will be more and more of those algorithms, and
19:53
Speaker 1: their quality will be getting better and better every year
19:58
Speaker 1: because there will be data there will be feedback, and
20:01
Speaker 1: the feedback can be incorporated into an algorithm much more
20:04
Speaker 1: efficiently than it can be in the human judgment. So uh,
20:11
Speaker 1: here I join Olivia's skepticism about most of the algorithms
20:16
Speaker 1: that exist, but I really want to register and mode
20:20
Speaker 1: of optimism about the future of that kind of operation.
20:30
Speaker 1: There's one trend which is about eliminating the human element
20:33
Speaker 1: to some extent, or at least having it in a
20:37
Speaker 1: more regular form in an algorithm, a more consistent form structured.
20:42
Speaker 1: Of course, the other big trend in business strategy and
20:49
Speaker 1: conversations about companies is the move is encouragement of diversity
20:54
Speaker 1: and to encourage businesses in a sense to have a
20:57
Speaker 1: wider variety of humans doing the judgment. And I wonder
21:00
Speaker 1: whether that even goes against some of the things that
21:03
Speaker 1: you're talking about. You know, one of the ways that
21:05
Speaker 1: companies might have previously eliminated noise, not necessarily error, but noise,
21:09
Speaker 1: would have been having lots of identical people or making
21:12
Speaker 1: the decisions all of these white men sitting in their boards.
21:15
Speaker 1: If you now have a greatly much more diversity, you
21:18
Speaker 1: might be more true to the range of human experience,
21:22
Speaker 1: but you'll be getting a lot more noise. Well, that
21:25
Speaker 1: is certainly true, but in in principle, we we want
21:34
Speaker 1: to distinguish between the process of generating a judgment and
21:39
Speaker 1: the final judgment. In the process of generating a judgment,
21:44
Speaker 1: diversity is very welcome. That is, you want multiple points
21:49
Speaker 1: of view, you want people ptise to enter into the
21:56
Speaker 1: participate in the conversation. But when a final judgment is made,
22:02
Speaker 1: we want a process that reduces noises. So diversity is
22:07
Speaker 1: very useful, and you know it's it's you can think
22:11
Speaker 1: of that in terms of, say, witnesses to a crime.
22:16
Speaker 1: So you're better off if the witnesses are in different
22:20
Speaker 1: places and see the event from different perspectives. And you're
22:24
Speaker 1: certainly better off if if the witnesses don't talk to
22:28
Speaker 1: each other and they are independent of each other. And
22:31
Speaker 1: so thinking along those lines gives you an idea that
22:36
Speaker 1: you do want diversity, but you want also the kind
22:41
Speaker 1: of independence and the kind of goal directiveness that reduces
22:45
Speaker 1: noise in the final journey. Diversity in the outcome of
22:49
Speaker 1: these decisions, in the judgment that you produce in the end.
22:53
Speaker 1: It's good for some things, but for most it's not.
22:56
Speaker 1: When you when you go to the doctor and the
22:58
Speaker 1: doctor tells you, oh, you have is disease. And then
23:00
Speaker 1: you go to another doctor and he tells you you
23:02
Speaker 1: have that disease. You don't say, oh, that's wonderful, it's diversity.
23:05
Speaker 1: You say one of these two doctors is wrong, maybe both.
23:09
Speaker 1: So whenever we think that there is a correct answer,
23:12
Speaker 1: diversity in the outcome is not good. Maybe the way
23:16
Speaker 1: to get to the correct outcome is to harness the
23:18
Speaker 1: diversity of the perspectives or through multiple witnesses, and that
23:22
Speaker 1: is one of the remedies that you can have to
23:24
Speaker 1: reduce noise. But as an organization, what you're aiming for
23:28
Speaker 1: is not every person having their own opinion. It's any
23:33
Speaker 1: person having the best possible judgment. And we've talked about business,
23:37
Speaker 1: we've talked about justice or you know, sentencing and decisions
23:42
Speaker 1: within the criminal justice system, and an area that comes
23:46
Speaker 1: up a little bit in your book, but obviously it's
23:47
Speaker 1: kind of front and center of people's minds at the
23:49
Speaker 1: moment when we think of the decisions being taken around
23:52
Speaker 1: the war in in Ukraine. Is that in a critical
23:57
Speaker 1: moments of foreign policy or military strategy decisions, you know,
24:04
Speaker 1: you can't necessarily enlist a lot of people and listen
24:08
Speaker 1: to their structured answers on a set of questions in
24:12
Speaker 1: reaching your judgment about how to respond to Russia or
24:17
Speaker 1: how to how to respond to one of the sort
24:19
Speaker 1: of very pressing situations that can arise in foreign policy.
24:23
Speaker 1: So I just wonder whether you whether you'd reflected on that,
24:26
Speaker 1: you know, if you're Anthony Blink in the sector of state,
24:28
Speaker 1: or if you're President Biden, or or that matter, at
24:32
Speaker 1: a Russian general how what does decision hygiene look like
24:36
Speaker 1: in those kind of situations where there's inevitably going to
24:39
Speaker 1: be a limited number of people that you can call
24:42
Speaker 1: on and imperfect information hygiene is something that an individual
24:49
Speaker 1: can follow. That is, there are better and less good
24:54
Speaker 1: ways of individual judgments. You want to cover all the
24:59
Speaker 1: bases you are to think, You want to the extent
25:02
Speaker 1: possible to think of all possible consequences, you know, as
25:05
Speaker 1: salient example in the Ukraine War, is it looks unlikely
25:09
Speaker 1: that that people who started that war knew that Finland
25:14
Speaker 1: and Sweden would want to join NATO, because you know,
25:18
Speaker 1: after all, this was supposed to keep NATO away. So
25:22
Speaker 1: when I have the feeling that not all the bases
25:24
Speaker 1: were covered in making those critical, so there are all
25:31
Speaker 1: we can hope for is that we have people with
25:34
Speaker 1: a lot of experience, because it turns out that there
25:37
Speaker 1: is genuine intuitive experience that can develop over time with
25:42
Speaker 1: institution within certain kinds of decisions and choices. And we
25:47
Speaker 1: also want people who, even under sometime pressure, UH, can
25:52
Speaker 1: follow the basic dictates of decision hype. I've noticed a
25:56
Speaker 1: professor kind of and that a lot of interviews with
25:58
Speaker 1: you are quite long, a long than the sort of
26:01
Speaker 1: the norm for whatever program it is, And I suspect
26:03
Speaker 1: it's because it's so it's so it's always so fascinating
26:07
Speaker 1: to listen to you, and you always want to have
26:08
Speaker 1: another question. But we're going to run out of time.
26:12
Speaker 1: So thank you very much for coming on Stephonomics, and
26:15
Speaker 1: thanks thank you to Olivier Simbony, thank you, thank you
26:18
Speaker 1: very much. That's it for this episode of Stephonomics. We'll
26:26
Speaker 1: be back next week. In the meantime, do please rate
26:29
Speaker 1: the show if you like it, and check out the
26:31
Speaker 1: Bloomberg Terminal and News website for more economic news and
26:34
Speaker 1: views on the global economy. You can also follow our
26:37
Speaker 1: economics on Twitter. This episode was produced by Magnus Henrickson
26:41
Speaker 1: and Summer Said, with special thanks to Professor Daniel Kannerman
26:45
Speaker 1: and Olivier Sibon. Mike Sasso is executive producer of Stephonomics
26:49
Speaker 1: and the head of Bloomberg Podcast is Francesca Levi. The