Latest / The Innovation Show / The Half-Life of Facts with Samuel Arbesman: Why Knowledge Keeps Changing
Transcript
- 0:00Thank you as always to Kyndryl and the Kyndryl Institute with a unique
- 0:03blend of AI powered consulting, built on unmatched service capability.
- 0:08Kyndryl helps leaders harness the power of technology for smarter
- 0:11decisions, faster innovation, and a lasting competitive edge.
- 0:15Also, check out the Kyndryl Institute the Kyndryl Institute has a plethora of
- 0:20brilliant writing, brilliant thinking and thought leadership from many of
- 0:23the guests who have been on the show and will be on the show in the future.
- 0:27You can find that at Kyndryl.com/institute.
- 0:32Facts change all the time.
- 0:34Smoking has gone from doctor recommended to deadly.
- 0:37Meat used to be good for you, then bad to eat, then good again,
- 0:40and now it's a matter of opinion.
- 0:42The average internet connection is far faster now than it was 10 years ago.
- 0:47The language of science has gone from Latin to German to English
- 0:51and is certain to change again.
- 0:53Humanity has progressed from a population of less than 2 billion
- 0:57to more than 7 billion people in the past hundred years alone.
- 1:00We have gone from being earthbound to having had humans walk on the moon,
- 1:05and we have sent our artifacts beyond the boundaries of the solar system.
- 1:09Chess checkers and even jeopardy have gone from being the domains of human
- 1:13experts to one of computerized mastery.
- 1:16Our world seems to be in constant flux with our knowledge changing all the time.
- 1:21Even the most informed people can barely keep up.
- 1:25All this change may seem random and overwhelming.
- 1:28Dinosaurs have feathers.
- 1:30When did that happen?
- 1:31But it turns out there is actually order within the shifting noise.
- 1:35This order is regular and systematic and is one that can be described
- 1:40by science and mathematics.
- 1:42Today's guest offers a guide to the startling notion that our knowledge, even
- 1:47what each of us has in our head, changes in understandable and systematic ways.
- 1:53Knowing how knowledge works can help us make sense of our world, it can
- 1:56allow us to anticipate the shortcomings in what each of us might know, and
- 2:00help us to plan for these flaws in our knowledge, including the flaw.
- 2:05If you didn't notice that we've gone from 7 billion to 8 billion in the time
- 2:10that our guest wrote the book in 2012.
- 2:13It is a pleasure to welcome the author of the Half Life of Facts, Samuel Aman,
- 2:18welcome to the show.
- 2:19Thank you so
- 2:19much.
- 2:20Great to be chatting
- 2:20with you.
- 2:20This is exciting.
- 2:22Oh man, I have learned so much from this book.
- 2:24We talked about o Off air that so much has changed since you wrote it, including
- 2:28a lot of the tools that you mentioned in the book, but I found it a magnificent
- 2:33read, , very well researched, et cetera.
- 2:35I'd love you to tell us about your thoughts since you first wrote it.
- 2:39What's changed, what hasn't changed?
- 2:41And that'll set us up for some context for the book.
- 2:44on the one hand, I think the general rules about how, what we know shifts over
- 2:49time, those things are pretty, evergreen.
- 2:52Kind of perennial truths.
- 2:55In terms of what's changed?
- 2:56Actually one, one fun thing that actually I discovered, I think between the time
- 3:02book went to press and when it actually published in hardcover and then we
- 3:05were actually able to change it for paperback, was one of the stories I tell
- 3:11how errors propagate and how they're eventually rooted out is this well-known
- 3:15story about the iron content in spinach.
- 3:19So there's this well-known story that there was like a typo and then of course
- 3:23then people thought that spinach had a lot more iron content than it did.
- 3:26And as a result, that's why Popeye consumed spinach.
- 3:29And it's this whole story.
- 3:30And people have been writing about this story I think since like the early
- 3:341980s when someone wrote about this.
- 3:36include it in this, I include it in the book.
- 3:38And then of course once the book went to press, I discovered that it
- 3:41turns out this story of how error.
- 3:43Propagates and then gets rooted out, is itself erroneous?
- 3:47It turns out someone has actually done research and shown that, no,
- 3:49it was actually some sort of like, I think it was, it turns out that
- 3:52in spinach it wasn't necessarily that much more iron filled.
- 3:57There might've been some sort of mistake in how the science was done or whatever,
- 4:01but it was this weird thing of , the story of error itself was erroneous and then
- 4:05it took time to actually root that out.
- 4:08And then I was able to modify it for the paperback and then actually mentioned
- 4:11this in the in the afterward of the book.
- 4:13But that was just a one, like one small example of.
- 4:17Even when you're trying to understand how knowledge changes, how what we
- 4:20know changes, there's always going to be things that are modified.
- 4:24And so there was a professor of mine from graduate school, he once told
- 4:28me this story that he was teaching.
- 4:30He was teaching a course.
- 4:30I think he like went in on a Tuesday, lectured on something.
- 4:33The very next day he read an article that actually invalidated everything
- 4:37he had taught the day before.
- 4:38So he went in on Thursday or whenever the next day was when he was teaching.
- 4:41And he said, remember what I taught you?
- 4:43wrong.
- 4:44And if that bothers you, you need to get out of science.
- 4:47And so there's this idea that science, rather than it being just a body of
- 4:51knowledge, which I think is often how we think about science, it's really a
- 4:56rigorous means of querying the world.
- 4:57And so that rigorous means is not going to change.
- 5:00The body of knowledge might change though.
- 5:03And so there's this understanding that we have to recognize these
- 5:05things are always in draft form.
- 5:06And so whether or not it's the facts in the book itself which.
- 5:11Whi, which I'm sure have changed even more than I realized.
- 5:14Or even just kind of other things that we think about in our textbooks we
- 5:17have to recognize that kind of thing.
- 5:18I would say.
- 5:19One other thing that I will mention in the book is when I was talking about
- 5:23people reproducing scientific experiments and how we don't often get a lot of
- 5:27credit for just recapitulating what other things that other scientists have
- 5:30done and saying that, oh yeah, probably a lot of science is kind of messy
- 5:33and we're not necessarily gonna know whether or not those things are correct.
- 5:37since I wrote the book, I'm actually gratified to see that a lot of people
- 5:39have actually started doing a lot of things around reproducibility and actually
- 5:42repeating experiments to see to what degree certain well-known scientific
- 5:46results are actually true or don't really hold up on under scrutiny and
- 5:50realize, oh yeah, these things were kind of just some fluke or whatever it was.
- 5:53And so people have been doing that and so I'm actually really gratified
- 5:55to see that my expectation that no one would actually be doing
- 5:58those, those experiments is wrong.
- 6:00I was literally just reading about Fermat's last theorem in that
- 6:03respect where people thought it wasn't solvable and he said he had
- 6:07the solution, but he didn't write it in the margins and the fact that
- 6:11people assumed it was unsolvable.
- 6:14I think that was one of the things I really appreciated about the book
- 6:17was it makes you question what you're looking at or even what you reference.
- 6:22And I do a lot of referencing in my writing and I was
- 6:24actually thinking about that.
- 6:25I was like, don't ever take for granted the reference that somebody else gives.
- 6:30Go and search it for yourself, especially in this world.
- 6:33Yeah, Fermat's last theorem.
- 6:33He said he's a mathematician.
- 6:35And then in the margin of one of, of, of a text, he basically said, okay,
- 6:39here's this mathematical equation.
- 6:41And he basically posits something , about that equation and saying like there's no
- 6:46solutions beyond the cubes, or I forget exactly what it was, or the squares,
- 6:52and, and he is like, oh, but like the margin is too small to contain the proof.
- 6:55And of course this set off this like, I guess century quest to find it.
- 7:00And and then eventually it actually was solved . But that proof, it
- 7:05was not, oh, just a little too large to fit in that margin.
- 7:08It was much too large.
- 7:09And so there could be a situation where he probably was wrong about the proof,
- 7:14but at least it goaded mathematicians to actually make a lot of discoveries
- 7:18and do a lot of different bits of work.
- 7:20But more broadly what you're talking about of like checking references and
- 7:23things like that, it's very common where knowledge gets propagated from
- 7:28like one generation to the next, or one article to the next, and it's
- 7:32not always traced back to its source.
- 7:34And you discover that, oh yeah, things have been I guess copied
- 7:38incorrectly or written down.
- 7:42Wrong.
- 7:43Or certainly in the case of like references themselves, not even like
- 7:45the knowledge in the references, you can actually see the way in which incorrect
- 7:49references and like the page numbers are wrong or whatever has actually propagated.
- 7:52And so people have actually looked at this kind of thing as sometimes a,
- 7:56rough metric for whether or not people are actually reading the articles.
- 7:59I'm not really sure.
- 7:59That's entirely correct.
- 8:00'cause especially if you're using some bibliographic tool, maybe
- 8:02it just, it has an error in that.
- 8:04And so that being said though, I think it just kind of is a, a broader
- 8:10sort of proxy for recognizing that.
- 8:14Sometimes it's useful to take things based on experts.
- 8:17Sometimes you actually wanna chase things down, but recognizing the way in which we
- 8:23should question certain things sometimes, I mean, and I'll say this always with
- 8:26caveats and of course everything is full of gods, but but I think a healthy
- 8:31dose of questioning is is very important to understand certainly as a scientist
- 8:36are you kind of taking 'em as a given?
- 8:38Are they worth reexamining?
- 8:40Should you check the references?
- 8:42Should you check other things, checking out underlying sources?
- 8:44These kinds of things are actually very valuable to really understand
- 8:48and root out error as well.
- 8:49particularly I think, you know, we talk about AI hallucinations,
- 8:53but we do it ourselves.
- 8:54I was thinking recently about an episode that I love the way the dots connect.
- 8:58When I read a book like this, I was thinking about an episode we did
- 9:01with Elise Loehenen and who wrote a book called On Your Best Behavior,
- 9:05and , it's about how women were kind of framed in society, but mostly true
- 9:11literature and going right back to ancient books like the Bible for example.
- 9:15But I was, when I was reading about like say the transcription error of
- 9:20the spinach story, you told us that I was thinking about how much translation
- 9:25is based on the interpreter who was, the scribe, who was writing it , from
- 9:30maybe generation to generation or writing it through their own biases.
- 9:35So it always suited the person who was writing the story, whatever
- 9:38they believed in, et cetera.
- 9:40No, I love that And actually it reminds me, I mean, before, before
- 9:42we started recording, we were talking about publication editing process of
- 9:46books and things like that, and that's actually one of the really hard.
- 9:51hard aspects of writing is when you are trying to actually edit your own
- 9:55writing or read it over you, there is an assumption of what I, of what you thought
- 9:59you wrote versus what you actually wrote.
- 10:01And so there could be very obvious typos that you will just never notice
- 10:04because you have an assumption.
- 10:05And I, and I believe actually in
- 10:09the hardcover version of my book I made some like very like simple error about
- 10:17like describing something related to like, I don't know like metric prefixes.
- 10:20And it was one of these things where multiple people read this.
- 10:23And it was not until my grandfather read it over and it was like immediately
- 10:26like, oh yeah, this is wrong.
- 10:27And of course, and because I had, had the assumptions of what I thought.
- 10:31And but yeah, but more broadly, right, there's always going to be a mental
- 10:35framework to how you actually assimilate knowledge or assimilate information.
- 10:40And that is going to color all these different kinds of things in terms of how
- 10:44you perceive new facts, how you, how you choose to absorb knowledge or fail to, and
- 10:50there's lots of things around like certain cognitive biases, like confirmation bias.
- 10:54Like we tend to go towards things or are drawn to things that reinforce , the
- 11:00framework that we already have in our minds, and which makes it that much
- 11:03more difficult to root out errors.
- 11:06And actually, and related to in, in your introduction you were talking about
- 11:11with like since I wrote the book, it went from like having the population
- 11:15of like 7 billion to like now we're well into the eight billions on Earth.
- 11:20But there's a story, I believe I actually tell it in the book where.
- 11:24Someone told me that he was listening, this is years ago, he
- 11:26was listening to a, like, well-known like hedge fund manager or investor.
- 11:32And he was like, he started his anecdote with as we all know, there
- 11:35are 4 billion people on the planet.
- 11:36And , yeah, it might have been a while ago, but there were not
- 11:384 billion people on the planet.
- 11:39He was telling that, but it was because he had absorbed that bit of information
- 11:42and then had just maintained it for years and years and years without
- 11:47actually taking the effort to actually mentally update that bit of information.
- 11:51And I think that's the thing, when you think about stories, you hear,
- 11:54, for example, I'm into pushing the boundaries of my health, for example.
- 11:58So I'll try new supplements, and people will go, oh, creatine for example,
- 12:02is really bad for you, or whatever.
- 12:04And they're basing it on studies that were like 30 years old.
- 12:09And it's probably one of the most studied molecules at the moment.
- 12:12But they don't update the research in their head because as you say,
- 12:15it's kinda like this frozen moment in time that's sealed into the brain.
- 12:19And that's the fact forever.
- 12:21And that's what I love about the book, particularly when the speed of facts being
- 12:25revealed seems to be increasing as well.
- 12:28I thought what we'd do, Sam, was I'll pull out from the books gr some of
- 12:32the brilliant examples that you give.
- 12:33One of the ones at the moment that just came to mind, and I'll probably jump
- 12:37around the book a little bit, was to the, your very point there is if I am in some
- 12:43way incentivized, then my confirmation bias becomes even more enhanced.
- 12:49And I thought about this great battle between these two paleontologists
- 12:53to discover dinosaurs, which was one of your childhood passions as well.
- 12:59But one of the things that led to was a false dinosaur that I'm sure many
- 13:04of our audience think is still real.
- 13:06I'd love you to take it from there.
- 13:07right there, you know, I. Grew up loving dinosaurs when I was a little kid.
- 13:11I feel like many little kids are obsessed with dinosaurs and and certainly in my
- 13:16own like childhood, there were actually a number of dinosaur facts that were
- 13:22changing quite a bit when I was young of like recognizing that in fact, like
- 13:25many dinosaurs might have actually been warm-blooded instead of cold-blooded.
- 13:29And, and now we have a much better understanding of, of that they actually
- 13:33might have had colors and, and, and, and feathers and like, there was all this
- 13:36information that's kind of changing.
- 13:38And, of course I mean even though the picture of dinosaurs now is these like,
- 13:46I dunno, like fearsome chickens, these kite colorful fearsome chickens versus
- 13:50these like kind of slow plotting reptilian monsters that are kind of gray green.
- 13:54We often, whatever we kind of learned when we were younger,
- 13:57we often failed to update.
- 13:59And one of the kind of well-known dinosaurs from my childhood was
- 14:03the brontosaurus which was one of these like the giant four-legged
- 14:07dinosaurs that kind of walked around like with a really long necks.
- 14:11And and it turns out that, and that name just has not actually
- 14:19been an acceptable name for a dinosaur for many, many decades.
- 14:22I think at this point where it's actually the Apatosaurus.
- 14:24And it had to do with, I think that yeah, there was these two
- 14:29paleontologist Cope and Marsh.
- 14:31If I'm remembering correctly, been a while since since I've remembered the
- 14:35story so you can correct me on certain the details, but they kind of had this battle
- 14:38of like trying to like discover dinosaur after dinosaur who could discover more.
- 14:43And and it turns out, so the brontosaurus was actually, I think a version of
- 14:49a previously discovered dinosaur.
- 14:51In this case it was the Apatosaurus.
- 14:53And I think it might not only was it described wrong or maybe it was actually
- 14:56a juvenile of the original Pterosaurus but I believe they even put the wrong
- 15:00head on it if I'm remembering correctly.
- 15:03And so it was this thing that, like on the one hand, like there's this idea that
- 15:07like it maybe was just classification , or priority of the name or whatever.
- 15:10But it sounds like there actually might have been more in terms of
- 15:12like actually what the understanding was of this kind of dinosaur.
- 15:17And I'm sure, yeah, many people are like, oh yeah, Brontosaurus is sounds good.
- 15:19We'll use that Apatosaurus maybe is not quite as alliterative.
- 15:22I don't know.
- 15:23But yeah, right that was an example of one of these dinosaurs that
- 15:27really people might think is a valid dinosaur name, but not really.
- 15:31And we have like example after example of these kinds of things.
- 15:34One classic one is just Pluto, like is Pluto planet is not a planet.
- 15:39And of course it was reclassified in I think 2006 as a dwarf planet.
- 15:45And now it actually might even have different designation.
- 15:47They might have actually even changed that title I vaguely remember something
- 15:50reading something recently about that.
- 15:52But it was not because in this case, Pluto stopped existing.
- 15:55It wasn't like, oh, like it was a planet and then like it blew up
- 15:59and then now it's not a planet.
- 16:00It was more, it just, we learned more things about our own solar
- 16:02system and realized that Pluto was simply one of this larger class of
- 16:06things that were these very large objects beyond the orbit of une.
- 16:10And so it really couldn't fit the designation of planet.
- 16:13But of course, the first time that kind of thing has happened either.
- 16:17When asteroids were first like being discovered, these like the asteroids
- 16:21are these, the entire asteroid belt.
- 16:23There are these large bodies between Mars and Jupiter.
- 16:27The first few were actually classified as planets, like the,
- 16:30I think series is the largest one, and there's some other ones as well.
- 16:33And so in the same way that generations of children learned Pluto as a planet and
- 16:38then had to grapple with that changing knowledge, I include myself in that.
- 16:42That there were also generations, or at least a certain period of time where
- 16:46children were taught, I think in the 18 hundreds, that there were these other
- 16:49planets like series and other ones, which were eventually reclassified as asteroids.
- 16:53And so there's just this constant like reclassification learning new
- 16:58things and modifying how we actually have to think about the world.
- 17:02And I think for some people that can be really overwhelming.
- 17:07And I'm sympathetic to that.
- 17:09And I think though.
- 17:10At least from my perspective, it's actually really exciting.
- 17:13It's not to say, oh, like therefore, because we thought this was true
- 17:15and this now other thing is true, we have to throw everything out.
- 17:18That's not really how science works.
- 17:19That's this like, sort of asymptotic approach to the truth.
- 17:22And we can talk more about that.
- 17:23But for me, like at that frontier of like where we're learning all these new
- 17:27things, yeah, there's gonna be a lot of shifting knowledge, like whether it's
- 17:30like nutrition supplements or whatever kind of changing and people having
- 17:33outdated knowledge.
- 17:34But that means that's where the most interesting stuff is happening.
- 17:36And so playing at that frontier means you're gonna have to
- 17:38update your information.
- 17:41But it's still worthwhile.
- 17:41'cause then you get to play at that frontier of knowledge.
- 17:43What it tells you as well is the importance of ongoing learning.
- 17:46I think that was one of the things as well, that dawns on me
- 17:49and why I love doing the show.
- 17:51And I was complimenting Sam for those who were watching us on YouTube, on
- 17:54his library behind him, and he says, oh, that's only one of my libraries.
- 17:58And the one thing you learn by doing this is how little, you
- 18:01know, that's the, the big thing.
- 18:03And then, and then on top of that, that the facts keep getting updated.
- 18:07And that means that that ongoing learning is, is a competitive advantage today.
- 18:12I, I really felt that, but I thought we'd share some of your terms.
- 18:15So you call you, you have this term meso facts or meso facts,
- 18:20and I'd love you to explain that.
- 18:21And then maybe a couple of places where they show up.
- 18:24One of them, for example, and these are just fascinating examples, was that.
- 18:28A cytologist is somebody who explores the interior of cells.
- 18:32A famous one once said, the diploid chromosome number of 48 in man can now
- 18:36be considered an established fact stamp.
- 18:39That's done, never change again.
- 18:41That's one.
- 18:41And then the other one, and this is one you shared about your granddad,
- 18:45was the fact that when he learned about the chemical elements in the periodic
- 18:49table, there was a certain number.
- 18:51Today there are far more.
- 18:53idea behind, yeah, the meso fact is that we need to recognize that what
- 18:58we know, like the different kinds of facts or different bits of knowledge
- 19:02they change at different rates.
- 19:02Now, it certainly feels like right now, like everything is
- 19:05changing more and more rapidly.
- 19:06And so maybe there is some, some truth to that.
- 19:08But there are different kinds of knowledge that change.
- 19:12And there are certain types that change very rapidly.
- 19:15So like this is not necessarily like a scientific fact, but what
- 19:18the weather's gonna be like tomorrow or what the stock market close at
- 19:21yesterday, those kinds of things.
- 19:23You know, that if I memorized what the weather's gonna be like tomorrow, a
- 19:26month ago, that has little to no bearing on what that's gonna happen like now.
- 19:31'cause I have to recognize, okay, seasons change information is updating.
- 19:35And so those are things that change very rapidly.
- 19:37And on the other extreme, you have facts that change very
- 19:41solely or effectively never.
- 19:42And those are the kind of things that you assume you should learn them once,
- 19:45and then you don't have to worry about mentally updating those kinds of things.
- 19:47And so the example would be, I don't know how many fingers are on the human hand.
- 19:51You learn that fact and you're like, okay, that's like a, that's a set thing.
- 19:54I don't have to worry about changing.
- 19:56But in between are these meso facts.
- 19:57These are the facts that change on the order of decades or on
- 20:00the order of a human lifetime.
- 20:02And they can include things about the population of the earth, but they can
- 20:06also include facts about the state of our knowledge, like the number of elements in
- 20:10the periodic table and this thing, this fact, like how many there are has been
- 20:15changing slowly and subtly and surely.
- 20:17The problem is that we often learn meso facts, these slow changing
- 20:20facts, the same way we learn facts that are ones that never change.
- 20:25And we are not really incentivized to actually update our knowledge.
- 20:29And so we learn about.
- 20:32state of knowledge of dinosaurs, the current number of elements in
- 20:35the periodic table recognizing that these things actually are solely but
- 20:41surely subtly shifting over time.
- 20:43And so I think now the periodic table is, I think we're up to 118 elements.
- 20:47Certainly was far fewer.
- 20:49Yeah.
- 20:49My, grandfather, he lived to the age of 99.
- 20:51He learned lots of different things.
- 20:53He was trained as a dentist and actually related to the cytology thing.
- 20:55And like the number of chromosomes in a human cell, And so you
- 21:00quoted that cytologist, and of course that fact is wrong.
- 21:02There are not 48 chromosomes in a human cell.
- 21:04There are 46.
- 21:05it turns out there was a period of several decades where we were able to actually
- 21:10magnify the cell and actually count the number of chromosomes, but apparently not
- 21:14counted correctly, but it was miscounted and then it got propagated in textbooks.
- 21:18And my grandfather, he.
- 21:20Learned medicine during that period.
- 21:22And so he actually learned the wrong number.
- 21:24In addition to learning an outdated number of elements in the peric
- 21:27table, he actually learned the wrong number of human chromosomes.
- 21:31And I think yeah, and it wasn't, I think until the 1950s that that bit of it was
- 21:37actually like remeasured and or recounted, and they realize, oh, it's actually only,
- 21:40there's only 46 in, in instead of 48.
- 21:43But too often, we just don't realize that we need to constantly
- 21:47revisit a lot of these things.
- 21:49Sometimes that is until I dunno, our kid comes home and says, guess what?
- 21:53Dinosaurs look totally different.
- 21:55And then you're like, you're stunned by it.
- 21:56Even though of course knowledge has been changing slowly and subtly.
- 21:58But we often perceive it in these kind of like staccato jumps.
- 22:02There's kinda almost a generational overturn of knowledge.
- 22:05And, going back to what you were saying with reading and actually constantly
- 22:09having the need for revisiting and learning things constantly.
- 22:14And we talk, right?
- 22:16Certainly around the time and we, maybe we don't talk about it as much anymore,
- 22:20but certainly around the time I was writing the book, there was a lot of
- 22:22discussion around computer technology and the internet and whether or not
- 22:27these things are ruining our memory.
- 22:29And maybe that's true, but I actually think good part, like the upside of
- 22:33that, means that we're constantly to revisit knowledge and actually look
- 22:38things up and discover whether or not the things that are half remembered in
- 22:42our minds are actually still true or not.
- 22:44And so I actually think there is something to be said for, it's good to
- 22:47know a lot of facts and use that as a framework for understanding the world,
- 22:50but also you also need to have that like kind of mede fact, which is these
- 22:54things are all subject to revision.
- 22:55Most of the things, are actually these meso facts and they should be revisited.
- 23:00And yeah, I think having that sense of constantly needing to learn is
- 23:06very important and actually returning to medicine, I think medicine is one
- 23:10of the fields that has actually done a reasonably good job of inculcating
- 23:13that in medical students and physicians because, and they recognize that a huge
- 23:19number of things that they learn are going to become obsolete or outdated
- 23:23within a few years of medical school.
- 23:25Sometimes they're actually told this kind of thing explicitly within medical school.
- 23:29My father who's a retired dermatologist he mentioned a, he actually told me
- 23:32the story, which I believe I think I mentioned it in the beginning of the
- 23:34book, where a professor of his gave a multiple choice exam and the exam was.
- 23:41Identical from one year to the next, the actual choices were the same,
- 23:44but one year, one of the choices was correct, and the next year
- 23:47a different choice was correct.
- 23:48And you could, and medicine recognizes that.
- 23:49And there's, and there are tools to remain up to date, like there's online
- 23:52tools for these kinds of things.
- 23:54But I think we need to recognize that kind of thing in whatever field we're in.
- 23:58And I think the downside, going back to the kinda this
- 23:59generational approach to knowledge.
- 24:01When we are young, we are trained as generalists.
- 24:05We learn a lot of different things about lots of different fields and like
- 24:08geography and the sciences and history and English language and literature.
- 24:13And then as we get older, we specialize and we learn more
- 24:15and more about less and less.
- 24:16And we fail to mentally update any of the things that we
- 24:20learned when we were younger.
- 24:21And so that's why we often then are not confronted with the changing
- 24:25facts until our children maybe learn those kinds of things.
- 24:28And, yeah, maybe this is just sort of a pan or a plea or a
- 24:31charge to action of like, yeah, we actually should periodically try
- 24:34to actually revisit these things.
- 24:35'cause otherwise we're gonna be making decisions based on
- 24:38faulty and outdated information.
- 24:39We did a series, with a guy called Manu Kapur and his book
- 24:42called Productive Failure.
- 24:44And it was for that very reason.
- 24:45It was like the need to update these mental models.
- 24:48But to your point there about the idea of using some technology to be able to
- 24:54upgrade yourself by that, this idea of cognitive offloading where maybe you
- 24:59might use a calculator or chat, GPT is the whole idea there is that actually that
- 25:04allows you to actually connect more dots.
- 25:07He was saying that that's not, that's seen as a negative thing, but actually can be
- 25:10a good thing, especially if it's something that's basic and you have mastered
- 25:13already, then you can go up a level.
- 25:15I thought that was a really interesting connection that I I
- 25:18made as a result of doing the show.
- 25:20But there was one thing that, that you said there.
- 25:22I thought was really interesting was the idea that if you, if, if you're,
- 25:29say your, your, your, your dad, your granddad was a dentist, your dad was a
- 25:33dermatologist, but he used his skills to connect dots in a very unique way,
- 25:40and I'm bringing us here to the idea of using the, the, the power of the crowd.
- 25:44And here he actually solved one of the solutions on incent.
- 25:48Yeah,
- 25:48I'd love you to share that story.
- 25:50is this I actually don't even know if it's still around.
- 25:52it is actually, , they sponsored the show recently.
- 25:55So in INNOCENTIVE, it's this
- 25:56Crowd sourced solution platform where the idea behind it is that if you
- 26:02have a problem, some sort of like scientific question or some sort of
- 26:04other technical kind of question.
- 26:07It might feel insurmountable.
- 26:09There is a decent chance that the crowd who has access to different
- 26:13kinds of information and different bits of knowledge could potentially
- 26:16solve , that kind of problem.
- 26:17And so yes, , my father, he's a retired dermatologist.
- 26:21He saw a challenge related to finding new ways of diagnosing
- 26:27ALS the neurodegenerative disease.
- 26:29And one of the things he did was actually look to a book from 1880, , I
- 26:36think it might have actually been the first time ALS was actually described.
- 26:39And he noticed this curious fact that it, I think it mentioned just
- 26:43kind of in passing that patients with a LS did not develop bedsores.
- 26:47And so he realized, oh, wait, as someone.
- 26:50Who's a dermatologist and kind of understands things
- 26:51about skin, that's curious.
- 26:53Maybe it has to do with skin elasticity.
- 26:56And so he developed this hypothesis around being able to diagnose like very early
- 27:01on ALS by measuring skin elasticity.
- 27:05And eventually, yeah, and one, I think one of like the hypothesis tests, I
- 27:07don't remember exactly what it won, but it was one of these things of
- 27:10like being able to kind of combine different bits of knowledge , it's a
- 27:13neurodegenerative disease, but in this case, was drawing on information from
- 27:18dermatology, from understanding skin.
- 27:20And the truth is this is the kind of thing that we need more and more
- 27:25certainly as scientific knowledge and just kind of knowledge more
- 27:28generally becomes, larger and larger.
- 27:30There is no way that, even decades ago, anyone could hold
- 27:34all of that in their heads.
- 27:36And certainly now it's completely overwhelming.
- 27:38And so we need.
- 27:40Either individuals from different kind of areas to kind to draw on bits of
- 27:44information they that maybe subject matter experts would not otherwise know.
- 27:48Or even going back to your cognitive offloading, we need computational
- 27:51tools to actually allow us to help stitch information together.
- 27:54And so one of the first examples and kind of approaches to do this
- 27:57kind of thing was this information scientist by the name of Don Swanson.
- 28:02He wrote this paper called undiscovered Public Knowledge.
- 28:05And this is in the mid 1980s.
- 28:06And he basically developed a thought experiment and he said, okay, imagine
- 28:10there's somewhere in the literature that a. A paper that says A implies
- 28:14B, there's somewhere else in the literature, maybe in a different subfield,
- 28:17maybe an entirely different field.
- 28:19There's another paper that says B implies C. And so if you combine
- 28:22them together, you would say, oh, actually maybe A implies C 'cause
- 28:25I can combine them together.
- 28:26But no one human has ever read these things.
- 28:28And so therefore that knowledge, that underlying information is actually
- 28:32undiscovered, but it's public.
- 28:33And so it's there, but no one actually knows this kind of thing.
- 28:36And so at the time he actually, he was not contend leaving
- 28:38it as a thought experiment.
- 28:39And so he used the kind of then cutting edge computer technology, which in
- 28:43this case was, I think looking for keywords and like a medical database.
- 28:47But he actually found a relation, like he found, I think he made a number
- 28:50of different medical discoveries, including one where he found the, a
- 28:53relationship between like consuming fish oil and helping to reduce like
- 28:59certain issues around like some sort of a circulatory disorder.
- 29:02And then he actually, I think he ended up publishing in a medical journal
- 29:04even though he was not a physician.
- 29:06And of course since then.
- 29:09made huge strides in the kinds of computational tools that can be
- 29:13used to actually surface this kind of undiscovered public knowledge.
- 29:16I mentioned several of them in the book, I believe.
- 29:19And of course since then, now with generative AI and tools that can
- 29:22ingest huge amounts of scientific literature, we can just do more and more.
- 29:26And I think that kind of collaboration between humans who can notice interesting
- 29:31things or even, or, but also use computational tools to help say,
- 29:36okay, how I, how can I find unexpected collisions between these different
- 29:41ideas or take these computational tools and say, okay, now I can aim
- 29:44them towards these kinds of things.
- 29:45I think that kind of, that partner, that human machine partnership is
- 29:48going to become increasingly important allow us to actually do this sort
- 29:52of combinatorial discovery process.
- 29:55I think it's really interesting when you read in different fields, if you
- 29:57read it eclectically, you start to notice patterns with things and you go,
- 30:02that thing that happens over here is the exact same that happens over here.
- 30:04I write a weekly article and for that reason I've quoted you many
- 30:07times in recent articles including the spinach paradox I call it as
- 30:12well, but the, it's because you spot these either metaphors or analogies.
- 30:17You also spot that if you read right back to the early literature, for example,
- 30:22in disruption in companies, you find that the Mark Twain quote is very true.
- 30:26That history doesn't repeat what it rhymes.
- 30:28So you see these templates all the time and you can see them very clearly.
- 30:32And I think that's one of the things I look forward to, technology now
- 30:36being able to mass provide this way of thinking for the world.
- 30:41Which leads me to this point, and I want to just say to our audience,
- 30:44stay tuned for exponential growth.
- 30:46So I've said at the start, Sam gives us lots of tools to understand
- 30:50exponential growth is one.
- 30:51The Moore's law of everything is another one.
- 30:53Many people will be familiar with Moore's Law, but I, I thought about
- 30:56something there, Sam, which is.
- 30:59The speed of discovery of everything.
- 31:02And you mentioned, for example, with medicine is also enabled
- 31:05by the changes in technology.
- 31:08And I thought recently about how, say for example, you see these true crime
- 31:12documentaries or maybe some type of series on Netflix or whatever platform you watch
- 31:19on and you see that these, they have these resurrected cold cases and it's now
- 31:24because now the technology is available to be able to look at the DNA and then
- 31:30they're able to solve the crimes, et cetera, even identify bodies, for example.
- 31:34And I thought, well, that's the same thing, same template is
- 31:38what happens with knowledge.
- 31:39Because as the technology enhances our access to the knowledge or our
- 31:43understanding of the knowledge changes.
- 31:45Right as we learn more, it's going to affect, how we place everything that
- 31:50has come before us kind of in context.
- 31:51And certainly as we develop new technologies that in turn allows
- 31:56us to understand new things.
- 31:57And I think right there is this deep interrelationship between
- 32:01technological advancement and certainly tool development and the
- 32:05growth of our scientific knowledge.
- 32:06And so certainly one simple thing will just be around like measurement.
- 32:11as we have gotten better and better tools to measure our surroundings
- 32:15and quantify it visualize at all these different kinds of things,
- 32:18we have in turn learned new things.
- 32:20I mean, like certainly the, I mean the interior of the cell for example, like
- 32:26that, I mean, as we've developed better microscopy techniques, better staining
- 32:30techniques to actually kind of highlight certain things, we've learned a lot about.
- 32:35The organelles, like the kind of the, these, these things
- 32:37within, with, within the cell.
- 32:39But also we've learned, I mean that's kind of at a very small level, but
- 32:42we've also learned things at the level of the globe as we have gained better
- 32:46and better techniques to visualize our planet with satellite imagery to
- 32:50measure certain things down to very, very tight precision with like global
- 32:54positioning system, things like that.
- 32:56We have in turn created a better and better model of our own planet.
- 33:00And of course, and you can see this with, and there's like weather prediction,
- 33:03as we have more and more weather tools, we've not only been able to predict
- 33:07weather better, but we might actually understand how, how weather works better.
- 33:11But there's just example after example of like, I dunno, increasingly
- 33:16powerful particle accelerators that has in turn led to new knowledge about
- 33:21fundamental ideas around physics.
- 33:23The idea is that, right?
- 33:25Like we think of kind of technological advancement as kind of, oh, this
- 33:28thing of like, oh, we're getting a new gadgets or I dunno, better, better
- 33:31battery power for our phones, whatever.
- 33:33And yeah, there is a lot of that, but a lot of those things are also
- 33:37deeply connected to our ability to actually understand the world itself.
- 33:41And so see that as these technological advancement hap happen, they move hand
- 33:48in hand with better scientific knowledge.
- 33:50And certainly even with like, as we now have these new AI tools that
- 33:54can in turn allow us to maybe stitch together different domains that
- 33:57we might not otherwise have been able to actually connect together.
- 33:59And so there's, yeah, there's a lot of these tightly intertwined marches of
- 34:05technological advancement going hand in hand with scientific advancement.
- 34:08Which tees us up beautifully for exponential growth.
- 34:11And I, I have this little just excerpt to tee you up here, Sam, to take us
- 34:14away on this because this is such an important aspect of technological change.
- 34:20So imagine you were given a penny and you're, I, by the way, Sam,
- 34:25I have to admit this to you.
- 34:26This is a terrible thing I did.
- 34:27I remember saying to my son this one day, I said, Hey, do you
- 34:31want me to give you a penny?
- 34:33And I gave him this.
- 34:34I said.
- 34:37So I'll set this up because it was kind of cruel, but he, he just gave me this
- 34:42terrible look and I could tell what the thought bubble was saying about me.
- 34:47So imagine you're given a penny and begin doubling it each day.
- 34:50After a week, you would be receiving less than $1 50 a
- 34:54day, but give it one more week.
- 34:56Now you're getting more than $80 a day within a month.
- 35:01Your allowance is more than $100 million a day.
- 35:04That's the power of exponential growth.
- 35:07exponential growth, right?
- 35:08It's not and it's something that our.
- 35:11are we did not evolve to kind of think about these like highly
- 35:14nonlinear systems where things double and there's kinda this feedback.
- 35:18But right.
- 35:18Exponential growth this process of doubling and cumulative where you're
- 35:23growing not by a constant amount.
- 35:26You're going by a constant rate.
- 35:28It could be a doubling, it could be some smaller rate.
- 35:30And turns out that a lot of our scientific knowledge and even our technological
- 35:36knowledge, and certainly we can discuss Moore's Law as well, in the context,
- 35:39they obey these kinds of doublings and these kinds of like rapid growth.
- 35:43And so it can be, so in terms of like scientific knowledge, even like one rough
- 35:47proxy is just the number of scientific papers that are being published and that
- 35:51obeys these kinds of growth properties.
- 35:53And you can look at, abilities of our, I think particle accelerators might adhere
- 35:56to one of these kinds of things in terms of the kinds of things can be done.
- 35:59But also yeah, just like how what we know right , is growing.
- 36:04More and more rapidly.
- 36:06And it also goes hand in hand, going back to what I was saying
- 36:09with like technological growth.
- 36:10Technological advancement also obeys this exponential kind of
- 36:14curve and exponential property.
- 36:16And the yeah, so like the kind of, the classic example is Moore's Law.
- 36:23So Moore's Law was developed by
- 36:25gordon Moore I think this might have been before, he was one
- 36:29of the co-founders of Intel.
- 36:30I can't remember exactly the timing, but it was this empirical observation
- 36:34he noticed, which was, he just noticed that the number of transistors.
- 36:39On circuits on chips was doubling.
- 36:43I think initially he said maybe about every 18 months and eventually it was
- 36:45modified to be about every two years.
- 36:48And he did this bit with , three or four data points.
- 36:50It was some very little, very small kind of thing.
- 36:52And remarkably, this relationship of the number of transistors doubling
- 36:58has held up for a very, very long period of time for many, many decades.
- 37:02And I think people have always talked about like whether or not it's gonna break
- 37:04down, but it has held up remarkably well.
- 37:09Exponential growth holds across different technological techniques being used to
- 37:14allow this exponential curve to happen.
- 37:17And the interesting thing is, 'cause each tech, each individual
- 37:20technology, underlying technology for memory storage or whatever
- 37:22it is might eventually saturate.
- 37:24Rather than getting this like exponential growth, you get something called an
- 37:26S-curve where it starts exponentially and then eventually saturates as we I dunno.
- 37:31Lose the ability to continue to advance that technology.
- 37:35But as one s-curve saturates, another S-curve kind of takes its place as a
- 37:41new emerging technology takes its place.
- 37:43And people have looked at this kind of thing of like how to understand
- 37:45innovation is these series of s-curves that when they're stacked
- 37:48together, something approximating this sort of ex exponential growth.
- 37:53But it's this remarkable yeah, this remarkable process where
- 37:58even though the underlying technologies might be changing, the
- 38:06like advancement of processing power, information, storage, what have you
- 38:12these kinds of things are actually remarkably regular and there's a lot of.
- 38:15Discussion around why is that so how do we get these things?
- 38:17And some people talk, maybe it's a self-fulfilling prophecy of like,
- 38:20oh, could, because we want Moore's law to hold, we're gonna just keep on
- 38:23trying to do these kinds of things and maybe there's something to be that.
- 38:26I think also there's, to a certain degree, just the fact that as our population
- 38:31is growing rapidly, that often goes hand in hand with more scientists and
- 38:35more technologists and more engineers being able to make discoveries.
- 38:38And of course that's part of this larger conversation of whether or
- 38:41not there is an increasing burden of knowledge and how we make discoveries.
- 38:44Are discoveries slowing?
- 38:46This is also kind of part of these just larger body of knowledge known as
- 38:50like science toomes , or meta science of trying to actually quantitatively
- 38:54measure how science, the process of science and how it's done.
- 38:57What are the things that actually make science easier?
- 39:01What makes it more likely?
- 39:02How do we actually get these scientific discoveries?
- 39:04What, what is, what are the sort of the underlying properties
- 39:08of scientific creativity?
- 39:09How do we think about multiple independent discovery?
- 39:11There's, this is a massive field.
- 39:13It's unbelievably fascinating, which is one of the reasons I wrote the book.
- 39:17But it's wild to see that we actually do have the capacity to quantitatively
- 39:21understand this thing that you would think, oh, it's it's so difficult to
- 39:24describe like discovery and creativity are these very special processes.
- 39:27No, it turns out in the aggregate there are regularities and whether it
- 39:31takes the form of kind of a Moore's law of everything or this kind of
- 39:34exponential growth of scientific papers there are these, yeah, these regular
- 39:38patterns to how what we know grows.
- 39:41if you're working in future orientated aspects like strategy, you're able
- 39:46to actually use Moore's Law as a map.
- 39:48You're able to understand exponential growth.
- 39:50You're able to see that yes, this product or service that we're building may not
- 39:56work today, but actually will work in the future because these laws continue.
- 40:00They will continue the whole way.
- 40:02The iPod came around.
- 40:03That way, they understood that Moore's law would actually solve the storage
- 40:07issue, and they actually built the whole.
- 40:08Frame the advertising behind the iPod before it was even
- 40:11developed, and then they saw that Toshiba had solved the problem.
- 40:15They bought the patent for the Toshiba storage device.
- 40:17So I thought that's why it's so valuable to understand all these aspects and
- 40:23all these different mathematical models and scientific models because it just
- 40:26helps you deal with the uncertainty or the seeming uncertainty of everything.
- 40:31But one thing, Sam, I'd love you to lean into a bit was you
- 40:34were talking about the S curve.
- 40:36And how the S-curve goes from a rapid growth stage to a plateau stage.
- 40:42And one of the things that you pointed out was, if you think of, for example, a Petri
- 40:46dish and there's bacteria grown in that Petri dish, it has a certain capacity.
- 40:51And I thought about the S-curve as you only has a, have a certain amount
- 40:55of customers for your product, or so many people will buy your product and
- 40:59then they turn into repeat customers.
- 41:01So you can't keep growing.
- 41:03And one of the terms that you introduced me to here was carrying capacity.
- 41:07the
- 41:08simple way to understand it right, is bacteria within a Petri dish,
- 41:10when you have one bacterium that's doubling and like, so it creates two
- 41:14bacteria and then kind of four and then eight and so on and so forth.
- 41:17At the very early stages, , the doubling is the process that is
- 41:22kind of the most important feature.
- 41:24But eventually as these bacteria double more and more, it is going to saturate
- 41:30that Petri dish and it's going to slow down because it turns out there is not
- 41:34an infinite amount of nutrients, or there are, or you're going to bump into
- 41:38other bacteria or you're going to bump into just the borders of the Petri dish.
- 41:41And so.
- 41:43On the one hand, you have that very early exponential growth, but then
- 41:46eventually you're the, you reach caring capacity kind of slows down.
- 41:50You you saturate and you reach these other kinds of features of the system and right.
- 41:55And then, and you can analogize this to many different things.
- 41:58And so in technol, in technological advancements, it can be things around
- 42:01the the maturity of a technology.
- 42:03And so like very early on, maybe when something is first being developed,
- 42:08there's a lot of low hanging fruit.
- 42:09And so it's , very easy to make this thing faster and faster
- 42:12and or better and better.
- 42:12And eventually you pick all these low hanging fruit and the
- 42:15development gets slower and slower.
- 42:16And you can also look at the same kind of thing of like right as
- 42:19a new product hits the market.
- 42:22Every customer is going to be new, and, but eventually, right you're going to
- 42:26slow down 'cause they're, and you're going to run out of new customers and
- 42:30like this is, I know, and it reminds me of was it the CEO of Netflix.
- 42:34Reed Hastings, he has the like famous quote of , like our
- 42:36biggest competitor is sleep.
- 42:38Like, when you saturate the market, that's the kind of thing you're working on.
- 42:41Like you're not trying to find new customers, you are trying to compete with
- 42:44a fundamental like physiological thing.
- 42:48And so yeah, like being aware of the ways in which an exponential can
- 42:55potentially break down I think can be really valuable for understanding whether
- 43:00or not you're going to be bumping up, up against these carrying capacities or
- 43:03kind of the slower part of the S-curve.
- 43:05I always think about rabbits.
- 43:06So you have a population rabbits and they're going, oh, this is great.
- 43:09We've got a nice piece of land here.
- 43:11We're gonna populate the land.
- 43:12And then it's kind of like you break a marketplace and then people
- 43:17kind of want to steal your lunch.
- 43:18But in this case, the rabbits are the lunch and a lamb comes a competitor
- 43:23like a, an apex predator for example.
- 43:25And they go, actually, this is where we're gonna settle down.
- 43:27There's lots of pastures here for us to feed on.
- 43:31And it's the same thing as the carrying capacity.
- 43:33They'll get to a certain size competitor comes in, or predator in this case.
- 43:37And then the ecosystem changes.
- 43:40And I think that's a thing that we have to accept about the, the pace
- 43:45of change is that this just happens.
- 43:47It's natural, it happens in every aspect of evolution.
- 43:50And this brings us to the pace of discovery.
- 43:53And I'm jumping right back here to the exponential chapter where you
- 43:57talked about Derek, the Hoya Price.
- 43:59I probably butchering his name there,
- 44:01And the science of Trics because again, it was a term and I'd love to
- 44:05share with our audience some of these terms just to make sense of things.
- 44:08Derek deSolla Price, he was a I think by trade initially, like a historian
- 44:13of science he was actually involved in kind of the antikythera mechanism
- 44:17of like trying to understand this like ancient Greek gear structure that
- 44:22actually was involved, I think, in trying to understand certain things
- 44:25around like celestial behavior.
- 44:28But he also was, I would say probably, I would say widely considered like
- 44:33the father of psychometrics, like this quantitative study of science.
- 44:36And the story goes of like, one of the, kind of his first discoveries
- 44:39was, he was studying somewhere and there was like, I think it might've
- 44:43been like somewhere in Singapore, the university library was under renovation.
- 44:47And so they gave him like a complete series of like some
- 44:49like scientific journal.
- 44:51And so he just like took the whole thing, took it home and
- 44:53like stacked it against the wall.
- 44:55And he started looking at the shape of like the height of these journals.
- 44:59And he found that it wasn't like this linear relationship and it wasn't flat.
- 45:04It actually had this very clear exponential curve.
- 45:07And he realized, oh wait science has this very clear shape.
- 45:11And , he began then to just collect bits of information and facts about scientific
- 45:17discovery and scientific knowledge growth.
- 45:19And he realized there were these clear quantitative relationships.
- 45:24And it's one of these kinds of things where yes, every single
- 45:28discovery has its own special story.
- 45:31And they're all every disco discovery is special in its own way.
- 45:34But when you look at all of science in the aggregate, then suddenly everything
- 45:39goes from being fairly unpredictable to actually realizing though there are
- 45:43these clear quantitative relationships, like how what we know grows over time.
- 45:47Is it having these exponential growths?
- 45:50we reaching an S-curve in certain developments are, can we actually
- 45:53try to quantify these things?
- 45:54And the truth is, this is also behind in the underlying title of my book,
- 45:58the Half-Life of Facts, which is a kind of by analogy to radioactive material.
- 46:04I had a single atom of some radioactive.
- 46:07Material.
- 46:08I can't tell you if it's going to decay in the next fraction of a second or in
- 46:11the next million years or whatever it is.
- 46:13But things change when I get a whole chunk of that radioactive material.
- 46:18Suddenly it goes from being entirely unpredictable to
- 46:20actually being quite regular.
- 46:21And you can actually trace out the actual half life of how long it's gonna
- 46:23take for half of the atoms to decay.
- 46:25I'm, I can't really tell you which of those fa, which of
- 46:27those atoms are going to decay.
- 46:29But I know that half of them are going to decay.
- 46:31And the same kind of thing is true with scientific knowledge
- 46:34that there is this regularity.
- 46:36When we look at science, when we take a step back and look at the larger picture,
- 46:42we realize that there is this shape to how knowledge grows, how scientific
- 46:47discovery is being made, how the tools we use and the technologies we have
- 46:51can impact scientific discoveries and kinda the shape of technologicals and
- 46:55even how knowledge gets overturned there are actually regularities
- 46:57to that kind of thing as well.
- 46:59So that's scientometrics, but there was another term also,
- 47:02you introduced Eureka metrics.
- 47:03Yeah, this is a term I developed along with some collaborators.
- 47:06I think when I was doing my postdoc, and this was actually around
- 47:10the quantification of scientific discovery itself and trying to see
- 47:14whether or not discoveries adhere to some very clear pattern in time
- 47:19and how that kind of relates to the difficulty of discovery over time.
- 47:22And and I believe actually DeSolla Price, he was also invi.
- 47:25He looked at a little bit of I think it was going back to actually the
- 47:29periodic table, like looking at like the discovery of new chemical elements.
- 47:32And so we looked at, yeah, chemical elements and I think certain things around
- 47:38like minor planets, like asteroids as and, and, and it turns out there are these
- 47:44kind of like quantitative relationships.
- 47:47And you can kind of create interesting models around, okay, based on certain
- 47:50assumptions of like, are we plucking the low hanging fruit or is all the
- 47:54easy stuff being discovered first?
- 47:55Then do we have to learn more things?
- 47:57And it requires more effort to actually make further discoveries.
- 48:00And I think there's actually a great deal of truth to that kind of thing
- 48:02where it's, and oftentimes when a field is new, the discoveries
- 48:06come fast and relatively easily.
- 48:09And then of course as we learn more and more the discoveries might continue
- 48:13to come quite regularly, but it's not because they're of equal, ease
- 48:19for discovery, but it's because we're exerting exponentially more effort or more
- 48:24scientists are involved in that field.
- 48:27And this is actually one of the things people have looked at like
- 48:29the increased burden of knowledge.
- 48:30And whether it's like harder and harder to make discoveries at
- 48:33the frontier of knowledge because you have to learn more and more.
- 48:35And similarly it might require more and more scientists working together to
- 48:39actually continue to make discoveries at this kind of constant rate.
- 48:42And thus far we've actually, our human population, which I assume is
- 48:45correlated with scientific population, has been growing quite rapidly.
- 48:48And so therefore science is proceeding a pace.
- 48:50But all these different kind of aspects are features of that, overall
- 48:56shape of discoveries themselves,
- 48:58Since we've started a show, we've gone to 9 billion people on the planet.
- 49:01talking quite that long.
- 49:03but actually I wanted to talk about that.
- 49:04'cause we had on the show, brilliant guy, Geoffrey West,
- 49:07he wrote a book called Scale.
- 49:09I see a nodding brilliant book.
- 49:11So we did four parts actually with Geoffrey on that book.
- 49:13It was a magnificent book, but you talked about the Santa Fe Institute, where
- 49:17he was the leader of that institute.
- 49:20But.
- 49:21One of the reasons I bring it up is you talked about the fact that if the
- 49:25earth is getting bigger, and cities in particular are getting bigger,
- 49:29there's more collaboration, and as a result of more collaboration,
- 49:32there's more science or there's more breakthroughs as a result of that.
- 49:34I'd love you to share your thoughts on that, because I thought that
- 49:37was, this was really important, Sam.
- 49:39I wrote an article a few years ago, and it was after COVID where people
- 49:44started to work from home and it was WFH work from home what did I say?
- 49:49DFI, disastrous for innovation.
- 49:52And what I would get was getting at was that the lack of collaboration,
- 49:56bashing out ideas, disagreeing when it needs to happen respectfully, all this
- 50:01kind of stuff, that it's very good, difficult to do that on a call like this.
- 50:06Even depending on if people are working on that independently and
- 50:10then sharing their knowledge together.
- 50:12But it's much easier to do as a team where you're bringing all these
- 50:14different people with their different backgrounds, different neurodiversity
- 50:18together in order to collaborate.
- 50:21And I thought it was really interesting you said a group of researchers at
- 50:25Harvard Medical School looked at tens of thousands of articles published
- 50:29by its scientists and mapped out buildings on campus where they worked.
- 50:33And through that work, they were able to look at the effect
- 50:36of distance on collaboration.
- 50:39And they had found exactly what they had assumed, but no one had ever measured,
- 50:43which was the closer two people are the higher the impact of the research
- 50:47that results from their collaboration.
- 50:50And they found that just by being in the same building as your collaborator,
- 50:54it actually makes your work better.
- 50:55. Right, like distance, even down to the level of the building, can have that
- 51:00kind of impact on , the combinatorial aspects of collaboration or the
- 51:03serendipitous kind of kind connections or just the ability to share and exchange
- 51:08ideas in some sort of productive way.
- 51:10I think that's, yeah, super interesting.
- 51:12And anyway, and it mirrors many of the kinds of things, that Geoffrey West
- 51:15and his collaborators have studied, which is this idea, that there are
- 51:18these increasing returns to scale.
- 51:19That, that when cities get bigger.
- 51:22They're not just generating more innovation and more ideas,
- 51:25they're actually generating more innovation and ideas per person.
- 51:28There's the kind of the super linear relationship and I think like we
- 51:33have to take into account kind of the geographic aspect of this kind of thing.
- 51:36I'm of a complicated mind about working from home and the ability
- 51:40to collaborate across distance.
- 51:41'cause I actually think when it comes to
- 51:46there are ways of overcoming distance.
- 51:48And certainly one of the other interesting things though is certainly
- 51:50when it comes to scientific innovation, kind of other kinds of innovation,
- 51:54there's also increasing returns to like intellectual diversity.
- 51:59And presumably the more distance you are, the might, you might be exposed
- 52:02to very wildly different ideas now, geography versus intellectual distance,
- 52:06that, that could be an open question.
- 52:07You, you could be very far apart and still have be exposed to
- 52:10the exact same kinds of ideas.
- 52:11But I do think.
- 52:13That maybe there's this interesting interplay on the one hand you want to be
- 52:17geographically proximate to have rapid exchange of ideas, but you also want to be
- 52:22intellectually distant because then you're going to be exposed to different domains.
- 52:27And if you can productively overcome jargon, barriers and things really allow
- 52:31you to do this kind of like combinatorial recombination kind of thing that we've
- 52:34been talking about of combining things from different domains together.
- 52:37I think it's a complicated dance there of how we can do those kinds of things.
- 52:41But I do think that, trying to understand what are the determinants
- 52:46of creativity and discovery, whether it's factors of geography, whether
- 52:50it's certain things around people coming together from different areas.
- 52:53And I think there, there was research done a number of years ago looking
- 52:57at patents that arose from like very different science, like dis like
- 53:00disciplines or technical domains.
- 53:03I'm not sure I'm gonna remember this entirely correctly, but it was something
- 53:05to the effect of that the more varied the domains or where the people were
- 53:09coming from who were involved in these kinds of things, the lower, the average
- 53:12impact of that kind of patent or that kind of work, but the higher the variance.
- 53:16And so oftentimes when you're coming from different areas, yeah, it's
- 53:19actually really hard sometimes to make useful collaborations because you may
- 53:23be talking past each other, you don't really know what you're talking about.
- 53:25But when it does work, it can have this high variance, it can be really
- 53:28valuable and really impactful.
- 53:30And so I think just trying to understand, what are the features of creativity and
- 53:36novel discovery and how those things can be balanced together is something
- 53:40that yeah, we need from the world of meta science and scientometrics
- 53:43and I just want there to be more research into this kind of thing.
- 53:46Serendipitously when I was researching your book, I was reading parts of
- 53:51Everett Rogers book, the Diffusion of Innovations, and he talked about people
- 53:54he called Cosmopolites or Cosmopolites.
- 53:58And these were people who traveled widely or read eclectic and read
- 54:03widely more broad than deep.
- 54:06And I thought about how, to your point there, it's that necessity
- 54:11, so I like working on my own.
- 54:12I like working, like going to my cave, going to my library and just studying.
- 54:17But what I think.
- 54:18Is that it's the collaboration or the conversations.
- 54:22I'm very lucky I have conversations like this, but very few people get to
- 54:26have those conversations because they are so busy or so focused on a target.
- 54:32And I think in doing that, you miss subtleties of a conversation,
- 54:37the throwaway comments, the water cooler moments that, that
- 54:41is difficult to reproduce unless you're a certain type of person.
- 54:46And what I mean is if you have more forum type conversations where people
- 54:51can discuss and beat up ideas, et cetera, after they come outta their cave, that,
- 54:57that you can just miss the collaboration.
- 54:59And I'm setting us up here for a very interesting story.
- 55:02You tell in the book about the collapse of essentially the bridge that connected
- 55:07Tasmania to Australia and what happened as a consequence of that collapse.
- 55:12I love this idea of needing these kinds of collaboration interactions among people
- 55:16and the story that you're mentioning is there used to be this, land bridge
- 55:20between Australia and then Tasmania.
- 55:24And when it vanished there was a much smaller population remaining in Tasmania.
- 55:29And as a result, not only did, so, it was a smaller
- 55:34population relative to Australia.
- 55:36Knowledge was actually lost where it was because the population was so small.
- 55:41Not only could there not be, I guess there, there couldn't be.
- 55:45Specialization, but there also couldn't be the collaborative
- 55:47power of not only not building new technologies, but actually certain
- 55:50technologies can no longer be preserved.
- 55:52'cause there wasn't in that population, the the critical mass required to
- 55:58preserve that kind of thing as opposed to, as compared to the technological
- 56:01complexity on the mainland of Australia.
- 56:05and I think the researcher who was involved in this also just kind
- 56:07of correlated it with the size of populations and the sizes of land
- 56:10mass in general, which showing that like the larger population you have
- 56:13that is interacting, the more in innovation that can be happening.
- 56:21But but I would say one thing, and actually I didn't mention this, don't
- 56:24believe I mentioned this research in my book, is that we often, certainly
- 56:30within science, we don't necessarily optimize or incentivize certain of
- 56:35those kinds of connect like kind of connective kind of tissue roles.
- 56:40And so there's some really interesting research that came out maybe 10, 15
- 56:44years ago or so, it was looking at the productivity I think it was like
- 56:5150 years worth of like immunologists.
- 56:55And it was looking to see which researchers were like the most
- 56:59highly cited, but they also looked at in terms of like their papers
- 57:01being referenced by other papers.
- 57:03But they also looked to see which researchers were more highly
- 57:08acknowledged at the end of the papers.
- 57:09And so it was like, like at the end of a paper, in addition, you just say
- 57:12like, oh, thanks to these following people who kind of like helped me with
- 57:14like conversations or whatever it was.
- 57:16They looked at this one category of people who had a, mediocre level of citation.
- 57:20So they wouldn't necessarily be considered a top-notch
- 57:21like, like superstar scientist.
- 57:23But they had a very high level of acknowledgement.
- 57:25And it turns out when the, when those people died, the productivity of all
- 57:30their collaborators actually dropped.
- 57:32And so it shows that these people were actually really valuable for
- 57:36that scientific process of like maybe sharing ideas or connecting different
- 57:40kinds of bits of information together.
- 57:42and we need them.
- 57:43And there's a whole larger question of, okay, how do we
- 57:45incentivize this in science?
- 57:46But I think this idea that have to recognize that there is this much less
- 57:54tangible or maybe more, less easily measured kind of thing there is this
- 57:58role of like, when you have a large population, if it's all siloed or
- 58:01people are siloed, that doesn't matter.
- 58:03It is the cross connections and the cross pollination of ideas
- 58:07that is really really valuable.
- 58:08And, and one of the stories actually I mentioned in my book
- 58:11related to, I think when I was.
- 58:13I was a postdoctoral fellow.
- 58:15Me and a friend of mine, we were working on a paper and we had to find
- 58:17some sort of statistical metric for clustering of data or whatever it was.
- 58:21And we couldn't figure it out.
- 58:22We were searching for things on like online, couldn't find any
- 58:25answers, and we're like, okay, we'll just make up some measure.
- 58:27It's not gonna be great, but whatever.
- 58:28And I was like, oh, why don't we just talk to the statistician down the hall?
- 58:31We went to him and I feel like within under a minute he gave
- 58:34us the exact answer we needed.
- 58:36And it was because he had, he, I mean he was very smart and really
- 58:40good at statistics, but he also was able to fulfill that role of being
- 58:44that kind of connective tissue.
- 58:45And he was also able to overcome jargon, barriers because we didn't even know the
- 58:49kind of terms we should even look for.
- 58:51And I think that's one of these things where we think, oh, all
- 58:54this knowledge is out there.
- 58:55We should be able to stitch together bits of information.
- 58:59This should be this should be this golden age of scientific
- 59:01discovery and innovation.
- 59:02And in some ways it is, but even though everything is out there.
- 59:07If you don't even know the terms to look for, it's going to remain going back
- 59:10to the undiscovered public knowledge.
- 59:11It's just gonna remain fallow.
- 59:12It's gonna be there and be hidden.
- 59:14And so there is still, and maybe with AI this will change like maybe
- 59:17the AI will fulfill this role.
- 59:19But there still very much is a role for , people, or tools that can
- 59:22act as this connective tissue to allow the population as a whole to
- 59:26allow innovation to move forward.
- 59:28This is what I was getting at with the, with the people working together.
- 59:32But it's, it's more than physical proximity.
- 59:34It's the willingness for that colleague to give you the time and
- 59:38not to see you as a competitor and why should I help you, kind of thing.
- 59:41Which can sneak into academic organizations, unfortunately and
- 59:46scientific and every organization where there's more competition within than there
- 59:50is to the outside world . And the reason I mentioned that is I loved the study
- 59:55that you shared a. About Nobel laureates where when they were more of a mensch,
- 1:00:00they actually were more successful.
- 1:00:02It was linked to scientific productivity.
- 1:00:04To set you up here, you give the example in the 1960s of a lady called Harriet
- 1:00:09Zuckerman, a sociologist of science, which is somebody who studies the interactions
- 1:00:13and the interactions and people underlying the scientific entire scientific ventures.
- 1:00:19And she decided to study the scientific output of Lobel of Nobel laureates to
- 1:00:25see if any patterns could be seen in how they work that might distinguish
- 1:00:30them from their less successful peers.
- 1:00:32I'd love you to share the output of this.
- 1:00:34It was a brilliant one.
- 1:00:35I believe what they did was they looked at the the position of
- 1:00:39authorship in papers 'cause oftentimes.
- 1:00:42I think within the li within the literature, and of course
- 1:00:44it varies from field to field.
- 1:00:45It's like the most central person involved was the like the first author.
- 1:00:51And it was one of these things where I think she found that these,
- 1:00:56I'm not, it might have actually been eventual Nobel alerts, like
- 1:00:58fairly , early on in the career.
- 1:01:00They gave kind of pride of place to their younger collaborators.
- 1:01:04They let them have, be the first author very early on.
- 1:01:06And it was kinda this like very sort of, yeah, like mensch like approach of like,
- 1:01:10oh yeah, I, I like generosity of spirit.
- 1:01:12I wanna kind of allow other people to be successful.
- 1:01:15it turns out that there was a correlation of like that to give up.
- 1:01:21The first, like first authorship was actually correlated
- 1:01:25to massive productivity.
- 1:01:26It was like these Nobel laureates were, yeah, some of these people
- 1:01:29who were actually very, very giving and willing to not just take all
- 1:01:34the glory for themselves, but allow right their students or other
- 1:01:38researchers they were collaborating with to also share in that success.
- 1:01:42And that actually was a really, really important feature.
- 1:01:45And I think that , going back to what we're saying of like certain, certain
- 1:01:48things we incentivize in science of like making all these discoveries
- 1:01:51and making discoveries by yourself.
- 1:01:52But the truth is science and all of innovation is this highly collaborative
- 1:01:56effort and it's very team oriented.
- 1:01:58And actually there's been a lot of research in recent years around the nature
- 1:02:02of team science and like what are the kinds of teams and the makeup of teams.
- 1:02:05But there also needs to be this understanding that like if it's a team
- 1:02:10sport, then you actually need to really.
- 1:02:13think of it as a team sport.
- 1:02:14Like you you all rise and fall together and how you think about
- 1:02:17that kind of thing is very important.
- 1:02:18And making sure that other people can be apprenticed and mentored and
- 1:02:24share in that success so that they can become even more successful.
- 1:02:26And then maybe then they will create their own lab and guess actually
- 1:02:30mimic that same kind of behavior.
- 1:02:31And so those kinds of things are really, really important,
- 1:02:33Yeah, having played in sports and teams.
- 1:02:36I have played in teams where some of the best players are playing
- 1:02:39for themselves and the team never does well as a result of that.
- 1:02:42They're just playing for their own personal glory, which
- 1:02:45came to mind when I read this.
- 1:02:46I thought we'd finish Samuel on the asymptote of truth, and maybe
- 1:02:50you'll explain that term asymptote as well for those who don't know it.
- 1:02:54But I have a little quote here, and I love this.
- 1:02:56This was one of my, probably one of my favorite stories
- 1:02:59along with the dinosaur story.
- 1:03:01You said that anyone who was alive during the late Cretaceous between
- 1:03:04about 100,000,060 5 million years ago, I don't think there's many of them
- 1:03:09listening to the show, would've seen many familiar creatures such as the
- 1:03:13fearsome, tyrannosaurus, the duck billed.
- 1:03:15hadrosaurs , numerous birds and even a selection of small mammals.
- 1:03:19But if you ventured into the sea, you would've seen a wide
- 1:03:22variety of marine creatures.
- 1:03:25Among these animals was what's called a coelacanths, a gray, thick lipped fish.
- 1:03:31They were one of the most hideous creatures of this period.
- 1:03:34Sam tells us.
- 1:03:36And the coelacanth is an example of what's known as a Lazarus taxa living
- 1:03:41things that are presumed long extinct until contrary evidence is discovered.
- 1:03:46Seems like there's not a lot of them.
- 1:03:48Turns out Sam's gonna tell us a different story.
- 1:03:50The coelacanth yeah, it's this weird, like ugly fish.
- 1:03:53I imagine it's attractive to other coelacanths But it was presumed extinct
- 1:03:58for, thought, yeah, it was extinct for of millions of years until I think
- 1:04:05about a hundred years ago or so someone.
- 1:04:09Caught a coelacanth and realized, oh wait, this thing that people thought
- 1:04:13was long extinct actually still alive.
- 1:04:16And it was one of the, and one of these fish or one of these
- 1:04:19creatures that presumably was very well adapted to its specific niche.
- 1:04:25And it did not need to change over time or e evolution.
- 1:04:28And and it there, but it was just not known to people that it was
- 1:04:33still actually alive and right.
- 1:04:34These Lazarus taxa, these taxa that people thought were extinct but actually have
- 1:04:38been effectively resurrected because we now discover living versions of them
- 1:04:43is actually not entirely a rare thing.
- 1:04:46And so there was some research where someone looked at a number
- 1:04:49of different animals that had been thought to be extinct at some point.
- 1:04:53And I think they found like a third of them had actually been and for were
- 1:04:59found actually to still be absent.
- 1:05:00They were still, actually still alive.
- 1:05:02And it shows this larger idea.
- 1:05:05That we are slowly but surely approaching a true understanding of
- 1:05:08the world sometimes by discovering things that we thought were extinct
- 1:05:11or now actually still alive.
- 1:05:12But this is this idea of the asymptote, which is like in a graph
- 1:05:16you might never approach a certain value, but you're slowly but surely
- 1:05:19getting ever closer and ever closer.
- 1:05:21And so it's, you're asymptotically getting closer and closer to this kind of thing.
- 1:05:25And, the way to think about this in terms of knowledge again, is we're
- 1:05:29not just constantly overturning every, everything we thought we knew.
- 1:05:33We are slowly but surely asymptotically getting closer and closer to
- 1:05:36a true version of the world.
- 1:05:38And the way to think about this is there's a great quote by the the
- 1:05:42science fiction writer, Isaac Asimov that I mentioned in the book, he, he
- 1:05:46received from a reader a letter saying like, oh, we thought the earth was
- 1:05:49flat at one point and we were wrong.
- 1:05:51We thought the earth was a perfect sphere.
- 1:05:54But then it turned out it was actually an ablate spheroid.
- 1:05:57Like we were also wrong.
- 1:05:58Like how can we know anything?
- 1:06:00And.
- 1:06:02Isaac Asimov's response is basically if you think that thinking of the earth is
- 1:06:06flat is just as wrong as thinking of the earth is a perfect sphere, then your view
- 1:06:10is wronger than both of them put together.
- 1:06:12And it's this idea like, and it turns out you can actually measure the amount
- 1:06:15of error of believing the earth is flat versus like to what we actually have
- 1:06:18versus believing it's like a perfectly sphere spherical versus an ablate steroid.
- 1:06:22And we are solely but surely removing a certain amount of error.
- 1:06:25And so even though these views seem wildly different overall, we are
- 1:06:30approaching a, ideally a more complete version of what the world is now.
- 1:06:35Of course.
- 1:06:36And I imagine every generation has thought that that're like we've known it all.
- 1:06:39And now the rest is just like rooting out a few little errors.
- 1:06:41And of course, we're going to discover things that we thought
- 1:06:44we, we were true are actually quite different from the way the world is.
- 1:06:48for me that's very exciting.
- 1:06:49But I do think slowly but steadily, we actually do have a really good
- 1:06:53understanding of the world and we are asymptotically approaching hopefully
- 1:06:57a true understanding of reality.
- 1:06:58Beautiful.
- 1:06:59And I loved what you said.
- 1:07:00This is my final little quote for today, and then I'm gonna come
- 1:07:03to you, Sam, and ask where people can find you and reach out more.
- 1:07:06And don't forget, we have more from Sam as well.
- 1:07:08I'll show the other books now in a moment.
- 1:07:10You said here, this sort of large scale analysis is not just for understanding
- 1:07:15the nature of a Lazarus taxa.
- 1:07:17It can be extended more generally to enable us to understand the entire
- 1:07:21edifice of science and all education we might argue, and how we overturn
- 1:07:26long held scientific beliefs.
- 1:07:28By looking at how science changes overall we can see the patterns in how scientific
- 1:07:33knowledge is revised and it can lead us to measuring the half life of facts.
- 1:07:38Beautiful.
- 1:07:40Nice cherry on top from me today.
- 1:07:42Sam, maybe we'll come to you to share where people can find out more about
- 1:07:45you, your work, your writing, et cetera.
- 1:07:47So my website is arbesman.net, so just my last name.net.
- 1:07:51I I have a newsletter you can subscribe to there.
- 1:07:54I think it's at Arbesman dot sub stack.com.
- 1:07:58And yeah, and then you can find a whole links to selections of
- 1:08:02my writing my books as well.
- 1:08:04And yeah, I've written three, and it sounds like we're gonna be discussing
- 1:08:07more of them, but yeah, so Arbesman.Net and my newsletter as well those
- 1:08:10are the places to find me online.
- 1:08:12Absolutely brilliant.
- 1:08:13So that was that half life of facts.
- 1:08:14Let's put that one on back on the shelf.
- 1:08:17I can feel like I've moved a little bit towards more knowledge today.
- 1:08:21And next up we're gonna have this book, Sam's second book Over Complicated.
- 1:08:24That's gonna be our next book next week.
- 1:08:26And then we're gonna move to his latest book just released, which
- 1:08:30is the Magic of Code as well.
- 1:08:31And Sam, I'll share all the links of where to find You, Substack, et
- 1:08:34cetera, for those people who are interested in finding out more.
- 1:08:38And just final word for me is to.
- 1:08:41Thank you, the author of Halflife of Facts, Samuel Arbeman,
- 1:08:45thank you for joining us.
- 1:08:46Thank you so much This is so much fun.
- 1:08:48Thanks as always to our sponsor, Kyndryl, with a unique blend of
- 1:08:51AI powered consulting, built on unmatched managed service capability.
- 1:08:56Kyndryl helps leaders harness the power of technology for smarter
- 1:08:59decisions, faster innovation, and a lasting competitive edge.
- 1:09:02You can find Kyndryl at KY NDR YL Kyndryl.com.