Latest / From First Principles / Interstellar Visitor 3I/Atlas, Human Longevity Plateau, New No-Sort Plastic & Analog AI (EP. 7)
Transcript
- 0:00Hello Internet, this is your captain speaking Lester Nare, joined as always by my co-host and our resident PhD, Krishna Chowdhury.
- 0:08This is From First Principles.
- 0:10We have some great stories for you lined up this week, starting with an update on the interstellar visitor 3i Atlas as we've seen four new instruments capture images as it makes its way towards Earth, followed up by a story about longevity.
- 0:25If you were born after 1939, you may not live to see 100 years of age.
- 0:30We'll talk about that and Brian Johnson, aka the man who wants to live forever.
- 0:35Our third story is about a new no-sort plastic that will allow us to recycle more efficiently.
- 0:41And we will end today with an interesting analog AI story coming out of Microsoft.
- 0:47This is FFP.
- 0:48Let's get after it.
- 1:04My friend.
- 1:05How's it going?
- 1:06We're back again.
- 1:07Yeah.
- 1:08Another one.
- 1:09I think we have a little something here.
- 1:10People seem to be excited about talking about science.
- 1:13Yes, dude.
- 1:14In the weeds.
- 1:15I'm really enjoying seeing all the feedback that we're getting.
- 1:17100%.
- 1:18Yeah.
- 1:19We're going to start with a very popular science story that has been all over the headlines.
- 1:22That's right.
- 1:24About 3A Atlas.
- 1:26The headline this week, four powerful telescopes agree, interstellar comet 3I Atlas really is bizarre.
- 1:31This is from a variety of outlets, but from space.com is where we sort it.
- 1:35And the new information here is both NASA and ESA, the sort of North American and European space agencies, have used their instruments, Hubble, Sphear X, JWST, and TESS to capture images of the object as it makes its way towards our sun.
- 1:49Yeah.
- 1:50So what's new here?
- 1:52So what's new here is we've actually gotten really nice data from the James Webb Space Telescope, from Hubble, and from the VLT and from a lot of these things.
- 2:03And they're converging on trying to identify really what this object is actually like.
- 2:09Okay.
- 2:10And some of the, you know, nitty gritty characteristics.
- 2:13So just to recap our viewers about what 3i Atlas is.
- 2:17Right.
- 2:18It was discovered on the 1st of July of this year by the ATLAS program, which is the Asteroid Terrestrial Impact Last Alert System.
- 2:29And this is a system that is part of University of Hawaii's Institute of Astronomy.
- 2:36There's basically a bunch of telescopes all around the globe.
- 2:39There's two in Hawaii.
- 2:40There's one on Maui, one on the Big Island.
- 2:42Then there's one in South Africa, Chile, Australia.
- 2:46and Spain in Tenerife in the Canary Islands.
- 2:49This particular one was discovered in the one in Chile.
- 2:51Okay.
- 2:53The whole point of this guy is just to peruse the sky looking for transient objects and objects that move around.
- 2:59Okay.
- 3:00So it was discovered there and then it turns out that
- 3:02You know, other telescopes had already seen it but hadn't identified it as this thing.
- 3:07We'd talked about the Zwicky transient facility in Palomar Mountain near San Diego, right?
- 3:11Yes.
- 3:12That thing actually had already found it in May but hadn't, like, pinpointed it as, like, a thingy that we should be worried about.
- 3:18Yep.
- 3:19So once we identified it with the Atlas program…
- 3:23everybody all over the globe was like, oh, let's just peruse the data because we know where it is, right?
- 3:27And where it would have been.
- 3:28And so from that, we could then get the trajectory of this thing.
- 3:32Yes.
- 3:32And once we calculated that trajectory...
- 3:35It was like, oh, whoa, whoa, whoa, whoa, whoa, whoa, whoa.
- 3:38Okay?
- 3:38It's moving really fast, 61 kilometers per second, all the way out in Jupiter.
- 3:44Yep.
- 3:45Okay?
- 3:45And if it's moving that fast all the way out there, that means it's not going to stay inside the solar system.
- 3:49Right.
- 3:50You can do the Newton's laws and do the calculation.
- 3:52It'll go right past the sun and then on its way.
- 3:55Mm-hmm.
- 3:56Then we got into these things about people who had these really blurry images.
- 4:00They're like, is it aliens?
- 4:01It's never aliens.
- 4:03Much to my chagrin.
- 4:04Yeah, yeah, yeah.
- 4:05We always hope, right?
- 4:06One can always hope.
- 4:07But time always tells that it's not aliens.
- 4:09And it turns out to be the third interstellar object, right?
- 4:14Which is an object that is not part of our solar system, that is literally going from star system to star system.
- 4:22around the galaxy of the Milky Way, right?
- 4:24Because the idea is there are these large gaps of void space in between, you know, star systems.
- 4:29And so it's from a probabilities perspective to because of the vastness of space.
- 4:35Yeah.
- 4:36And our ability to detect both of those reasons.
- 4:39We haven't seen a lot of these types of objects before.
- 4:41Yeah, we haven't seen a lot.
- 4:43Now we will be able to because of things like the Vera Rubin coming online and things like that, right?
- 4:47Yes.
- 4:47This is our third one.
- 4:48That's why it's called 3i.
- 4:50The i is actually for interstellar.
- 4:51Oh, there you go.
- 4:52And 3i Atlas is because Atlas was the program that discovered it.
- 4:56Right.
- 4:56Very.
- 4:57The first one is one eye Oumuamua.
- 5:00That was the really weird elongated thingy.
- 5:04And that one we caught on the way out, so we couldn't really get good data on it.
- 5:07The second one was two eye Borisov, which turned out to be an interstellar comet.
- 5:12And then now this was three eye Atlas.
- 5:14And so a key difference between Oumuamua, let's say, and Atlas is that we were able to catch Atlas on its way in, not when it was on its way out, which gives more time to capture more data.
- 5:28Yeah.
- 5:29As well as being able to see how it behaves over longer time periods.
- 5:32Yeah, exactly.
- 5:33It's like that scene from Office when I was like, don't panic.
- 5:36I said, stay calm.
- 5:37Like, OK, now it's like it's happening.
- 5:38Right.
- 5:39So now everyone's like scrambling to figure out how to image this thing, because once we've got it, like every astronomer who's a planetary astronomer, who is, you know, or planetary origins or an exoplanets astronomer trying to understand how solar systems form.
- 5:53This is a very big deal.
- 5:54Okay.
- 5:54Because the other thing is if you turn back the clock, this thing came from above the Milky Way, which is where there's an old population of stars that are much older than our sun.
- 6:03Right.
- 6:04Right.
- 6:04So this thing could be something like 7 billion years old.
- 6:07Our solar system is tops 4.6, 4.7.
- 6:11So this thing is older than, you know, anything that we've really had a close encounter with.
- 6:15Right.
- 6:15Now, the...
- 6:17The problem is when this thing gets close to us, we're going to be on the other side of the sun.
- 6:22Right.
- 6:23So it's coming in.
- 6:24We're on the front side of the sun right now and it's coming in towards us.
- 6:27But we're going to be ordering.
- 6:29It won't be here.
- 6:30It'll still be coming this direction and we'll be blocked by the sun.
- 6:33By the sun, right?
- 6:34It's like during –
- 6:35If you wanted to see it, it would be during daytime behind the sun.
- 6:38Yep.
- 6:39Right?
- 6:39Which, because of the atmosphere, we're not going to see anything.
- 6:43The sky is going to be blue, and the air glows more than any stars or this 3i atlas.
- 6:49This is why Vera Rubin is doing a survey, sky survey at night.
- 6:53Yeah.
- 6:54And not during the day.
- 6:55Yes, exactly.
- 6:56And furthermore, we can't really point the James Webb Space Telescope towards it either.
- 7:00Because, like, then the sun, the whole point of the James Webb Telescope, the reason why it's so nice and, like, sensitive is because it's got this giant shade.
- 7:11That shades it from the sun so that the instruments can be kept at like four Kelvin.
- 7:15Right.
- 7:15Like colder than like actually no even less than like there's like a literal like dilution refrigerator on that thing that is like keeping it colder than outer space.
- 7:25Right.
- 7:25Because then you get these instruments that are super cold.
- 7:28The instruments the atoms aren't jiggling.
- 7:30Right.
- 7:30So then the only signal you're getting is not from the instrument itself.
- 7:33Right.
- 7:34But from like the starlight.
- 7:35Right.
- 7:36There's less or no noise.
- 7:37Yeah, yes.
- 7:38But if you wanted to point it towards that thing, that defeats the whole purpose.
- 7:42That makes sense.
- 7:43So you can't really do that.
- 7:44That makes sense.
- 7:45So what we'd like to do is to observe it right now with our terrestrial-based telescopes like the James Webb.
- 7:53Yes.
- 7:54Now when it's sort of away from the sun.
- 7:56Yes.
- 7:56Get as much data as possible.
- 7:58Yes.
- 7:58And then as it goes through the solar system and it reaches Mars.
- 8:02Yes.
- 8:02Yes.
- 8:03It's going to be on the other side of the sun.
- 8:04It's going to be near Mars' orbit.
- 8:05Yes.
- 8:06We can have all of our orbiters that are orbiting Mars.
- 8:10Right.
- 8:11Sort of... And then point towards this thing and try to get as much data as possible.
- 8:16So the idea is we have orbiters around Mars that have a certain mission right now, right?
- 8:20A Mars-based mission.
- 8:23They can take a break.
- 8:24This is one of those, like...
- 8:26Not that often in the lifetime opportunity.
- 8:28It's like we can take a couple hours a day, reorient, use some of our fuel to do so, to capture, to provide that data when we on Earth, as well as JWST, don't have the capability or the angle of viewing to be able to actually properly capture it as it gets closer to our orbit.
- 8:49Yeah, and exactly.
- 8:49And with comets, you really want to look at the thing when it's close to the sun.
- 8:54Because that's when it's doing the most cool, crazy stuff.
- 8:57Right.
- 8:58Okay?
- 8:58When the comet is far away, it's just a chunk of ice.
- 9:01But as it gets closer to the sun, it's going to start interacting with the solar wind.
- 9:05It's going to start interacting with the photons that the sun is giving out.
- 9:08So then there's going to be chemical reactions and physical reactions happening on top of the comet.
- 9:13And that's what we want to see.
- 9:14Right?
- 9:15In the very, like...
- 9:17Way out there, when we tried to look at 3i Atlas, it was really bright for how far away it was.
- 9:24And that's what gave rise to a lot of these alternative theories about it's artificial and all this other kind of stuff.
- 9:29The light's not reflecting from the sun.
- 9:31It's generating its own light.
- 9:32It's generating its own light because it's so bright.
- 9:34How is that possible?
- 9:36Now, as it got closer, actually, so August 6th is when James Webb looked at it.
- 9:41And the preprint came out on August 25th.
- 9:43They were fast about this because they know that people want it.
- 9:46Right.
- 9:47So the preprint came out like literally they had like what, like 20 days to do all of the people were upset about how long it took.
- 9:54Yeah.
- 9:54Yeah.
- 9:55But dude, like 20 days to like massage data is kind of like create a story.
- 10:00Right.
- 10:01It's not just like you're analyzing the data.
- 10:02You have to like interpret the data.
- 10:04Try to create a story about like what you're trying to say.
- 10:07Right.
- 10:07Science is all about stories at the end of the day.
- 10:09It's not just numbers.
- 10:10Right.
- 10:10You have to have some kind of narrative.
- 10:12Right.
- 10:12So.
- 10:14They analyzed the data from James Webb Space Telescope.
- 10:17It used one of the instruments that is a spectrograph.
- 10:20So it can tell us things like the composition of this thing.
- 10:23And what they found was a really high mixing ratio for carbon dioxide and water.
- 10:29Okay.
- 10:29So usually the mixing ratio is quite low.
- 10:33Here it's eight to one.
- 10:34Okay.
- 10:35Okay.
- 10:35There's eight times as much CO2 as water.
- 10:37Right.
- 10:38That's like a lot.
- 10:39Yes.
- 10:39Okay.
- 10:39And that's very unusual for comets in our solar system.
- 10:43Correct.
- 10:44Okay.
- 10:44So that means that this thing, there's two possibilities.
- 10:47Okay.
- 10:48One is that when this thing was born, Mm-hmm.
- 10:51it had a very different birth environment than the comets in our solar system.
- 10:56It could be that this thing was born in something called the CO2 ice line.
- 11:00Okay.
- 11:00You can imagine when a star is forming and the solar system is forming around it, the star starts...
- 11:07making light and thermal energy, that starts going out, right?
- 11:10There's going to be...
- 11:11The disk is going to have a mixture of silicon, hydrogen, CO2, water, and all the dust from that primordial nebula that sort of became the star, right?
- 11:24So all of this stuff is going to be in the disk.
- 11:28There's going to be a line...
- 11:29Where inside that line, close to the star, there's going to be enough radiation to put CO2 in a gaseous form.
- 11:38Okay.
- 11:38Okay?
- 11:39But afterwards, there's not going to be enough radiation, not going to be enough heat, and that CO2 is going to become dry ice.
- 11:45Okay?
- 11:46So there's going to be this ice line where after a certain distance away from the star, you just have dry ice and before you have gaseous ice.
- 11:53Because also... Gaseous CO2.
- 11:55Carbon dioxide does not have...
- 11:56There's no liquid form.
- 11:57Yeah, I mean...
- 11:58So it goes straight from gas to solid.
- 11:59Yeah, yeah.
- 11:59I mean, there is a liquid form, but at, like, very peculiar pressures, right?
- 12:04Okay, that's fair.
- 12:05Like, in the low pressure of space, and even at, like, one atmosphere, there's... Like, at one atmosphere, it'll go directly from dry ice to CO2, right?
- 12:15If you put in high enough pressure, you can liquefy CO2.
- 12:17Okay, that makes sense.
- 12:18Right?
- 12:19But, like, out here, it's just going to go ice to gas.
- 12:22And back and forth.
- 12:23Right?
- 12:23Back and forth.
- 12:24So...
- 12:25You have this like dry ice line now you could be that like the comet was forming in this right past that ice line, right?
- 12:33So it's like gathering up a lot of co2 not a lot is a lot of water right because water the water line is elsewhere at right right right so
- 12:43That could be one reason why 3i Atlas has a lot of CO2 versus water.
- 12:49The other thing could be that it formed or it was subjected to a really harsh radiative environment.
- 12:57Okay.
- 12:58Okay.
- 12:58And then what can happen is you can have these reactions between carbon monoxide, which is also fairly common.
- 13:04Yes.
- 13:05Carbon monoxide and water with this high energy radiation to create CO2.
- 13:10Got it.
- 13:10And that's what happened, right?
- 13:11Got it.
- 13:12So there's these two possible scenarios, but in any case, it's still very, very different from any comet that we've seen.
- 13:18Which is, I think, what's interesting is there's this leap, you know, that folks like me who are not as educated always make where it's like, oh, we have no reference points, so that must mean it's aliens.
- 13:30And I think kind of what the through line you're drawing here is...
- 13:33We do know that it was birthed in an environment that is different than the environment where we have these data sets.
- 13:41Yeah.
- 13:42Yeah.
- 13:42And so those initial conditions matter.
- 13:44Yeah.
- 13:46And the data sets, to your point, the data sets that we have,
- 13:49on what is normal is like from our solar system.
- 13:53As you say, right, there's millions and millions of solar systems out there with different types of stars, different galactic environments.
- 14:01Like we are a tiny little sample size, right?
- 14:06And one of the great things and why everyone is so excited about interstellar objects is because it gives us a sampling of what's out there.
- 14:14Yes.
- 14:14Right.
- 14:14And so that's why everyone is like scrambling to try to get as much data as possible on this guy.
- 14:19Right.
- 14:20Because from that data, like we kind of talked about at the beginning of the story, there are multiple insights that can be gleaned, not only at time of capture, but also afterwards when we learn other things.
- 14:32And it's like, oh, let's go look back at the Atlas data.
- 14:35Yeah.
- 14:35Now that we have some different context about how these highly radiative environments work.
- 14:42work yeah or any number of other yeah options yeah exactly we can like start i mean you know we work we're kind of scrambling because like this thing's going to be out by september right right so right now we're just in the observe phase right okay after this thing gets out and we get all the data then i'm pretty sure there's going to be a big cohort of people that are going to go into the modeling phase right of trying to understand okay theoretically how is something like this possible right like if i were to model it this way would it match the data no well then that's not
- 15:12That's probably not what happened.
- 15:14And so, yeah, at this point, it's just like everyone's just like just pointed at the thing and get as much light as you can.
- 15:20What's so funny about this is, as I mentioned in a previous episode, I get the pleasure of being able to work with Dr. Avi Loeb on a regular basis, who is a professor of astrophysics at Harvard.
- 15:33you know, one of the things we'd reached out to him to do was to do a white paper on this new update from 3i Atlas.
- 15:40And to go with what you're just saying, his response was almost a more expanded version of what you just said, which is like, we need to wait for the dust to settle.
- 15:50Right now, it's just an observational stage.
- 15:53We need to focus on capturing as much data and information as possible.
- 15:57Once it's gone and that opportunity has left, then there's going to be time to actually settle in and do analysis on what it is that we just captured.
- 16:08So I think there's an important distinction to identify here, which is like even if it was aliens, right, we don't have any real baseline to reference for it, to identify it as such.
- 16:17And if it doesn't land on the White House lawn, there's going to be this two-stage data capture and observation, which is where we are now, and then sort of analysis and modeling, which happens after.
- 16:27And we will get more clarity, generally speaking, once the observation period is over and we move into this analysis and modeling timeframe, which is, again, how science works.
- 16:38Yeah, exactly.
- 16:39But there's a big public desire for answers, which is understandable.
- 16:48And like many things, it's just a process.
- 16:51So it's interesting you say that because it makes me think of that.
- 16:53Yeah.
- 16:53That letter we got.
- 16:54And like, and you know, it's definitely not aliens at this point, but it's still like one of the coolest objects that's ever visited us.
- 17:03Right.
- 17:04And so, I mean, I don't think people should be disappointed.
- 17:08Right.
- 17:09It's kind of like.
- 17:10A cop-out.
- 17:12I mean, you know, as the Buddhists say, like, don't have these expectations.
- 17:15Because the world itself is a wonderful place.
- 17:19Right.
- 17:19Right?
- 17:20Imagine this thing, like, going through the Milky Way for seven billion years.
- 17:25Right.
- 17:25Visiting, like, who knows what, right?
- 17:27This isn't... We're not the first star system that it's seen.
- 17:30Mm-hmm.
- 17:30Imagine from its point of view.
- 17:31It's gone from one star system to the next.
- 17:34The fact that it's going so fast means that it's had a pretty close encounter.
- 17:38Yeah, right.
- 17:38With something pretty massive.
- 17:40Right.
- 17:40To like be zooming through like this.
- 17:42Right.
- 17:42The sun is not really going to change its velocity that much.
- 17:46Got it.
- 17:47Right.
- 17:47It's just, it's sort of like redirecting it in one direction.
- 17:50Yep.
- 17:50But like this thing had a very close encounter.
- 17:53Like this, you know, like imagine from its perspective, it's been around...
- 17:58for like half the age of the universe.
- 18:02That's a long time.
- 18:02That's a long time.
- 18:03We've only been around for a third.
- 18:05So I think it's an incredible story, right?
- 18:08And to get back to the idea of we're trying to observe this thing as much as possible, right?
- 18:13So that's where the European Space Agency and this new stuff is coming in, right?
- 18:17Where the European Space Agency has a bunch of orbiters.
- 18:21around mars that they're like okay we're gonna we're gonna repurpose for this one of them is um the mars express and the other one is the exo-mars trace gas orbiter both of these both of these things have cameras that are pretty good this thing is still going to be pretty far away from mars but you know getting any sort of anything getting anything when it's on the other side of the sun and we can't put anything there
- 18:42And it's going to be the most volatile when it's on the other side of the sun.
- 18:45So getting any data at that point of its orbit, of its trajectory, I should say, not orbit because it's not orbiting, is going to be incredibly valuable.
- 18:54And the guys at the ESA are definitely tempering everyone's expectations.
- 18:57It's like, guys, it's going to be far away.
- 18:59Like, our stuff wasn't designed for this.
- 19:01It's like, okay, dude, like, no one's going to blame you if you get shit data.
- 19:06Like, just get whatever you can.
- 19:08And then the other thing is, so we also talked about the Europa Clipper in one of the previous episodes.
- 19:13So on its way back to Earth, it's actually going to cross through where the comet was.
- 19:21So as a comet goes across the solar system, it leaves behind...
- 19:26a trail of particles, of debris in its wake.
- 19:30That's actually how we get meteor showers.
- 19:32Meteor showers are literally just the Earth moving through cometary paths that have these particles.
- 19:40And just like planets, the particles are going to be going through the sun.
- 19:46They're orbiting the sun as well.
- 19:48So as the Earth goes through these cometary paths...
- 19:53any sort of particles that get trapped in the Earth's gravity fall down to Earth, and then that's how you get the Perseids and all of these meteor showers, right?
- 20:01But you can now imagine the Europa Clipper probe is going to be going through this thing, right?
- 20:07So we could be getting observations about
- 20:10the particulate matter that, you know, was a part of that.
- 20:13Yeah.
- 20:13Yeah.
- 20:13And it's not just new Europa Clipper.
- 20:15I think there's other places like Hira and Lucy, they may fly through the commentary tail.
- 20:19They're all NASA.
- 20:21Yep.
- 20:21So that's going to be super exciting to get like actual, like, you know, data.
- 20:26It's going to be both optical, like imagery.
- 20:28capture as well as like physical matter analysis.
- 20:32And I think this sort of, you know, this brings up the, when we build these really expensive, highly precise instruments for observation and data capture, they're not necessarily single purpose in this exact context.
- 20:47Yeah, yeah.
- 20:47It's like we send a bunch of stuff to look at Mars, but we can still use those same instruments for other use cases, such as,
- 20:54Hey, go just look at this thing that's coming through and let's see what we can get.
- 20:58Yeah.
- 20:58Yeah.
- 20:59It's pretty crazy because like I'm pretty sure when the ESA and when NASA like made these things, we didn't – you know, Oumu'a wasn't even a thing.
- 21:08Right.
- 21:08Right?
- 21:09When they were planning like – These were made well before we even knew.
- 21:11Well before we even – and then now it's like – now it's kind of nice that humanity has a solar system-wide presence.
- 21:18Right.
- 21:18Right.
- 21:18You know, where even though Earth is in a crappy part of its orbit and we're kind of handcuffed in that way, we can still get that data from other parts because we have this presence that's so big.
- 21:31That's kind of cool.
- 21:32It's really cool.
- 21:33It's why both near and deep space matter quite a bit.
- 21:37And while it may be the case...
- 21:42based on our second article, that we may not live past 100.
- 21:46Yeah.
- 21:47Let's hope that these tools and instruments maybe one day do capture alien life in our local neighborhood.
- 21:53Oh, that would be dope.
- 21:53That would be fantastic.
- 21:54That would be fantastic.
- 21:56But our second story is a similarly interesting one about longevity no longer increasing.
- 22:03Headline...
- 22:03Studies find generations born after 1939 unlikely to reach age 100.
- 22:09This is covered in the Independent.
- 22:12But the research was out of it was an international collaboration between the Max Planck Institute of Demographic Research, the Institut National d'Etudes Démographiques,
- 22:23And the University of Wisconsin-Madison, who we've mentioned on this podcast a couple of times now.
- 22:28And they published their paper in PNAS, which is the Proceedings of the National Academy of Sciences.
- 22:34And so people are probably most familiar with longevity as a concept or studies, either from the Netflix documentary, The Man Who Thinks He Can Live Forever, which is about this hundred millionaire, Brian Johnson.
- 22:46What is he doing?
- 22:47So he's doing all, he's getting the best doctors in the world.
- 22:49Okay.
- 22:50To like give him a regiment.
- 22:52So he's now allegedly decreased his actual age from his mid-40s, where he's in his 40s, to the bodily age of a 20-something-year-old.
- 23:02Right?
- 23:02Wow.
- 23:04So his whole thing is, unless I die in a freak accident, my body is literally...
- 23:09Is he one of these guys who gets blood transfusions?
- 23:13So I don't want to say specifically.
- 23:15Yeah, okay.
- 23:15But the only two angles are either the Brian Johnson story or the idea that all these billionaires are vampires.
- 23:20Yeah.
- 23:20Getting their young employees to give them blood.
- 23:22Yeah, because that's like a real thing.
- 23:24I saw news stories about that.
- 23:26I'm not sure with Brian specifically.
- 23:27Yeah, maybe Brian Johnson isn't doing that.
- 23:29Okay.
- 23:29But this is how in the pop culture.
- 23:31Everyone's obsessed with it.
- 23:32Right.
- 23:33People want to live longer, all this stuff.
- 23:35It's always been the case over the course of the year that like as generations go by we get older We are able to live longer.
- 23:41Yeah, this study is sort of suggesting not anymore.
- 23:44Not anymore.
- 23:45We've yeah We might have come to the end of the road with the low-hanging fruits.
- 23:48That's what this thing is suggest.
- 23:50Okay.
- 23:50Okay So longevity there's been this thing called the longevity revolution over the over the past century, right?
- 23:55life expectancy has been increasing like crazy over the last century and
- 24:00And that has everything to do with advancements in science.
- 24:03100%.
- 24:03Right?
- 24:04We've, like, figured out biology at a nitty-gritty level.
- 24:09We figured out, hey, like, sickness actually comes from little tiny pathogens.
- 24:14And we figured out ways to advance public health with vaccines, with antibiotics, with all kinds of, like, revolutionary technologies.
- 24:22technology, medical innovations.
- 24:25We've also had a lot of socioeconomic development.
- 24:27So in sanitation, in the eradication of infectious diseases, smallpox is no longer a thing, which is an incredible thing to think about, dude.
- 24:38Smallpox doesn't exist in the world.
- 24:41Which is controversial to bring up the fact that that's an incredible feat for humanity.
- 24:46For humanity and science and everything.
- 24:48Dude, I mean, and
- 24:50You know, I can't imagine it happening today, which is so sad, which is so sad, because like back when in the I think it was in the 1980s when, you know, we were at the last stages of eradicating smallpox.
- 25:04And there was just a tiny little bit of smallpox in Africa.
- 25:07OK. And in the middle of a civil war.
- 25:10Both sides decided to have a ceasefire so that health workers could go in and because there had been a small, smallpox outbreak there and health workers could go in and vaccinate everyone there.
- 25:23And then they started fighting each other.
- 25:25It's like, it's like, just stop fighting for like, for like a few days.
- 25:28Give us the time here.
- 25:30And then everyone's like, probably like.
- 25:32planning how to restart the fighting.
- 25:35But even in the Civil War, they respected the fact that, okay, nobody wants smallpox.
- 25:39Right.
- 25:40Like, I want to win the Civil War, but not at the cost of a nation with smallpox.
- 25:47I can't imagine that happening today.
- 25:49There's no – I mean, a funny story that someone always brings up to me about this is the former Senate Majority Leader, Mitch McConnell, I think when he was younger, had –
- 25:59Smallpox.
- 26:00That's crazy.
- 26:01And, you know, leader of the Republican Party in the United States for a long period of time, he's been very vocal about the defense of like science in this particular isolated use case.
- 26:13Yeah.
- 26:14And to your point, imagining any of the current global conflicts going on pausing to do a public health.
- 26:20No, I can't.
- 26:21It's hard.
- 26:22It's hard to envision.
- 26:23Yeah, it really is.
- 26:24It's hard to envision.
- 26:24Yeah.
- 26:25Which is sad.
- 26:26It really is sad.
- 26:27But like those are the advancements that got us this longevity revolution, right?
- 26:30Where we had an insanely increasing lifespan, average lifespan.
- 26:37Okay.
- 26:39And one of the things that happened as a consequence was policymakers just took it for granted.
- 26:45Yep.
- 26:46Okay.
- 26:46Where, yeah, of course, we're going to just keep living longer.
- 26:50Right.
- 26:50You look at the, you look at the, the trend of like how average life expectancy is increasing and it looks like a line.
- 26:58And so like any good high school student, they get three data points.
- 27:02They're like, oh, it's just going to go that way.
- 27:06Right.
- 27:07And so, and, and this, this paper is really putting that claim to rest.
- 27:13Right.
- 27:14A lot of people have been sounding the alarm, though.
- 27:17Because anyone who's reasonable is like, okay, just because it's linear for now doesn't mean it's going to keep staying linear.
- 27:24There's plenty of systems that go linear and then they plateau off.
- 27:29But there's been sort of two camps.
- 27:31One camp has been there is kind of an inherent...
- 27:35limitation to how long humans can live.
- 27:37Okay.
- 27:37Okay.
- 27:38Based on just evolution, mutation rates, the ability of our cells and our organs to keep up.
- 27:45Yep.
- 27:45Right.
- 27:45And then there's another camp that's like, well, you know, we could have enough science to,
- 27:51To circumnavigate.
- 27:53Science.
- 27:53Like inherent evolution, right?
- 27:56And just like replace bad cells and do all of this bioengineering to just make us live forever, right?
- 28:03So those are the two camps.
- 28:04This is sort of adjacent to the transhumanism kind of movement where they're like, there's going to be the symbiosis between all of our science and stuff.
- 28:12And then that way we'll be able to be beyond, we'll be this next thing that is...
- 28:16Yeah, yeah, yeah.
- 28:17We'll merge with AI or some nonsense, right?
- 28:21And it's like, okay, yeah, maybe in like 100 years, right?
- 28:25But not me.
- 28:26I ain't doing that.
- 28:28No, ain't no way, boy.
- 28:29But these are the two camps.
- 28:30But those are the two camps, right?
- 28:32And it's been hard to sort of justify one or the other without hard data.
- 28:37And that's what this group is doing from Max Planck, right?
- 28:41The paper that's come out in PNAS, it's...
- 28:46sort of taking a very rigorous approach to this problem.
- 28:50Okay.
- 28:50Because this problem is a hard problem to get good data and good analysis on.
- 28:55Okay.
- 28:55Okay.
- 28:56There's, let me, let me give you a sense of why it's hard.
- 28:59So there's two approaches to how we quantify life expectancy.
- 29:04Okay, there's the period life expectancy and then there's the cohort life expectancy.
- 29:08Okay, the period life expectancy is the easier one to quantify.
- 29:14It's basically the idea that reflects the average mortality risk in a given year.
- 29:19Right.
- 29:19Okay, so it's kind of like saying like, okay, like if a newborn is born now and you say the life expectancy is 80 years, but that's a period life expectancy.
- 29:27What you mean is that like given the climate right now,
- 29:33This newborn, given the mortality climate right now, this newborn would be expected to live 80 years, right?
- 29:38Given the chances of dying on a random person.
- 29:41Yep.
- 29:41Right?
- 29:42But that is a very local, local in time measure.
- 29:46Right.
- 29:46Right?
- 29:46Because if the COVID pandemic happens, that period life expectancy goes down.
- 29:50Right.
- 29:51If the Spanish flu happens in 1918, the period life expectancy goes down.
- 29:56But, like, it's kind of a live metric of life expectancy, okay?
- 30:00Then there's something called the cohort life expectancy, which is, like, saying, okay...
- 30:05The people born in 1950 in that birth cohort, the average lifespan of that individual is 80 years.
- 30:13Okay?
- 30:14That's different because that is taking into account this giant time span of 80, like 1950 plus whatever 80 years.
- 30:21Yes.
- 30:21Right?
- 30:22Yes.
- 30:23In principle, that's really hard to quantify unless everyone has died from 1950.
- 30:28Right.
- 30:29Right?
- 30:30Then you take everyone who died from 1950, you average it out, and you say that was the cohort life expectancy.
- 30:35So it can be useful in a retrospective context when you have a generation or cohort that's already...
- 30:40Yeah, that's already done.
- 30:42But it's not predicting.
- 30:43It's hard.
- 30:44You can't play it forward as like, well, we have a generation that's like halfway.
- 30:48Yeah.
- 30:49Yeah.
- 30:49So like maybe predict.
- 30:51Yeah, exactly.
- 30:52These unknowns about the future.
- 30:53Exactly.
- 30:54Yeah.
- 30:54Yeah.
- 30:55So you see now the struggle, right?
- 30:57That like scientists have in defining a cohort life expectancy of a generation that's still alive.
- 31:02Yes.
- 31:02And that's what these guys are trying to forecast.
- 31:04Yeah.
- 31:04Okay.
- 31:05Okay.
- 31:05And so the way they did it was really cool.
- 31:08They got six different types of models.
- 31:10So, you know, in social science, if you just do like a single model, lots of confounds, you want to do a bunch.
- 31:18That's why I like this paper, right?
- 31:19They were pretty rigorous about it.
- 31:21You do six different, different approaches, and you see if they all give the same answer.
- 31:26If they do, then it's a pretty robust finding.
- 31:28Got it.
- 31:28Right.
- 31:29On the other hand, if it's a giant spread, that means that the nitty gritties of the model and the initial data that you put in, that's what's messing it up.
- 31:35Right.
- 31:36So they did six different models, like the Lee Carter model, the cohort segmented transformation, age at death model, all of these like different kinds of models.
- 31:44They're basically like fancy data analysis techniques where what you do is you take a time series of data.
- 31:51of different age groups and how they're doing in terms of mortality.
- 31:55And then from that you project forward and try to get like a sense of, okay, when is the time series going to end?
- 32:01Okay.
- 32:02You try to do this for six different things.
- 32:04And what they came up with the same, they came up with the same endpoint, which is that this life expectancy is going up, but it's not going to get to a hundred.
- 32:12It's going to plateau.
- 32:13Okay.
- 32:14To validate it, you might be thinking, okay, well, these are just models, right?
- 32:17It's nice.
- 32:17To validate it, they forecasted life expectancy for people from 1919 to 1938 who are all dead.
- 32:25Okay?
- 32:25Everyone born in that time period are all dead.
- 32:27So you can take that data, right, as your test data in some sense, right?
- 32:32And be like, okay, I'm going to do the same analysis for this data from people born in 1919 to 1938 and then try to project when they're going to die.
- 32:42And it worked.
- 32:42And we have the answer for that.
- 32:43And we have the answer for that because we have the data about when they died.
- 32:46So we built a sort of predictive model to be able to work for current cohorts that are still alive.
- 32:50Yeah.
- 32:51And we validated it.
- 32:52And it worked across six models.
- 32:54And then we used a historical cohort who, where everyone's dead to put it in to see if it mapped onto the actual results we see saw.
- 33:03from that cohort that's now all.
- 33:05Yeah, and it was a little bit off, but not enough to justify what they were seeing with the present cohort.
- 33:11And it might be a little bit off because like, you know, when you're trying to do, like obviously the environment of the data back then is different from the environment now, right?
- 33:20But then you can make arguments about how off the results should be.
- 33:24And the results should not be that off compared to what we're finding now, which is that this thing is definitely plateauing.
- 33:30Okay?
- 33:30Yes, yes.
- 33:32The cooler part of this is they actually did a kind of causation of what is causing this plateau.
- 33:38Right.
- 33:39And what's causing this plateau is the fact that we have exhausted all the low-hanging fruits when it comes to longevity of human lifespan.
- 33:48We've taken all the low branches on the tree for extending life, and we've actualized.
- 33:53We've actualized them all because young people are now living longer, right?
- 33:57No one's, I mean, people, obviously people are dying before the age of five, but much less.
- 34:02Infant mortality is way down, okay?
- 34:04People dying before the age of 20 is way down because infectious diseases are way down, right?
- 34:10Like the problems that you have as a young person.
- 34:14are no longer the kinds of problems that you used to have before.
- 34:18Okay?
- 34:19Like, because of vaccinations, because of fundamental science, because of all of the advancement that we've been doing over the past century.
- 34:27The hard stuff is now the actual aging.
- 34:31Okay?
- 34:32That's the cancer.
- 34:34Right.
- 34:34That's the Alzheimer's.
- 34:37That's these higher order things that are notoriously hard.
- 34:43Because they're no longer...
- 34:44They're no longer agents that are trying to kill you.
- 34:48Okay?
- 34:48They're yourself.
- 34:50That's just like sort of at a cellular level giving up in some sense.
- 34:55Right?
- 34:55Like the neurons are sort of dying.
- 34:57Right.
- 34:57And the nervous system and the brain is in some sense deteriorating just because of...
- 35:03Like time.
- 35:04Right.
- 35:04Right.
- 35:04And in cancer cells, it's like the mechanisms that control the growth of cells is sort of giving up.
- 35:11Right.
- 35:12And then now you have these tumors growth.
- 35:13Right.
- 35:14So so it's a much more complicated problem now.
- 35:17Right.
- 35:17That.
- 35:18We haven't really had the kind of progress that we have had in cases like polio and smallpox and all of these other sort of, you know, quote, easier problems.
- 35:30They weren't easy at the time.
- 35:32But now that we've looking in hindsight, it's like, OK, they were all like agents.
- 35:36And now we have these like modular mechanisms to like solve that.
- 35:38Right.
- 35:39Oh, just make a vaccine.
- 35:40Coronavirus.
- 35:41Like within six months, we had a vaccine.
- 35:43Easy.
- 35:43Now we have to solve for our own body trying to kill us over time.
- 35:48And the open-ended issue with this is it's not clear that in the short or midterm that we're going to actually make this sufficient or significant progress that would lead to outcomes that were at the rate of progress.
- 36:06Exactly.
- 36:07Yeah, yeah, yeah.
- 36:08It doesn't seem that like it's not going to – we're not making progress at the speed that would like temper this plateau.
- 36:16You know what this reminds me of, funny enough, is in technology, there's this, you know, markets and cycles are defined by this S-curve, right?
- 36:25Yeah.
- 36:26Where you start, you know, with a low rate of change and then you have this explosive growth.
- 36:30And with every technology cycle, eventually it tapers off.
- 36:33Mobile phones is the perfect example, right?
- 36:35We went through years of Apple innovating and doing new things and combining all this stuff.
- 36:39And then all of a sudden everyone catches up and then we kind of get to the place where we are now where...
- 36:44Is a foldable versus, is that really, you know, or are we now just kind of making things for marketing?
- 36:50Yeah.
- 36:50And so this similar idea of sort of the S curves that you see in technology cycles.
- 36:56Yeah, it's happening in fundamental science when it comes to biology.
- 36:58When it comes to this longevity issue, it's like we kind of have reached the end of the first S curve.
- 37:02Yes.
- 37:02And so in technology, the idea is S-curves move, right?
- 37:05So it's like you first have like vacuum tubes, all this stuff.
- 37:07Then you get to microprocessors.
- 37:09Then you move to mobile, PC, mobile, et cetera.
- 37:12The open question is arguably we just went through the first, let's say, longevity cycle.
- 37:16Yes.
- 37:16S-curves cycle.
- 37:17Yes.
- 37:17And it's not clear.
- 37:19what the second S-curve cycle may or may not look like, and whether we can traverse it or not.
- 37:25Yes, exactly.
- 37:26And if we get to that S-curve, what is the real upper limit?
- 37:30Because right now, the upper limit, I think the record is 122 years for someone to live.
- 37:35Okay?
- 37:36And...
- 37:38Is that the real limit?
- 37:39Right.
- 37:39Is it at that point?
- 37:41The body is just like, nah.
- 37:42Right.
- 37:43Right.
- 37:44Evolution has literally programmed us to be like, no, no, no, we're still evolving.
- 37:49Right.
- 37:49The human genome has a really high mutation rate compared to like, like, for example, sharks.
- 37:54Right.
- 37:54Sharks have like a insanely low mutation rate, which is why their fossils 300, 300 million years ago look exactly the same.
- 38:01Right.
- 38:01There's no humans like even 10 million years ago that look like us.
- 38:05So the mutation rate is really high.
- 38:07On top of that, we're incredibly agile creatures.
- 38:13We're mammals at a high body temperature, high metabolism.
- 38:18So all of these things sort of start contributing to tempering an infinite lifespan.
- 38:24Right.
- 38:24The limits.
- 38:25We have these limits that exist that are fundamental to the existence of our being.
- 38:30Right.
- 38:31And it is not clear that they are necessarily surmountable by a human manufactured solution in human time spans.
- 38:38Exactly.
- 38:38Yeah.
- 38:39And what I liked, I mean, I guess not what I like about this story, but what concerns me about this story is that I think we need to, again, start taking this very seriously as a policymaking substrate.
- 38:54Right.
- 38:54Right.
- 38:55As like now a scientific fact that we have learned and urgently need to act on.
- 39:03Okay.
- 39:04Because from a policy perspective, I mean, to extrapolate this, there's huge arguments right now over the debt in the U.S. Yeah.
- 39:13Being at untenable levels.
- 39:15And one of the biggest line items in that is Social Security.
- 39:19Yeah.
- 39:20And it makes assumptions about retirement age and who gets Medicare.
- 39:24And what happens if you're the line of average life expectancy shifts or moves.
- 39:29Yeah.
- 39:30It's no longer...
- 39:31I mean, everybody has made this policy based on an increasing life expectancy forever.
- 39:36And now this paper is saying that actually, no, life expectancy has plateaued.
- 39:41We're at the end of the road when it comes to how old we can get.
- 39:44Right?
- 39:45Like all these...
- 39:46With pension funds, with social security systems, there was a riot in France the other year when the government tried to raise the retirement age.
- 39:57The reason why they're raising the retirement age is a pretty simple logic, which is if people are living longer, then they can work longer.
- 40:06And if they can work longer, we should make them work longer before they get their retirement age.
- 40:10Well, this isn't the case anymore.
- 40:11People aren't actually living longer.
- 40:13They're living the same as they were like 10 years ago.
- 40:16Right.
- 40:17Right.
- 40:17We're not actually making it...
- 40:21Right.
- 40:22And the worst part about these kinds of policies that sort of raise the retirement age is it actually impacts those of worse socioeconomic background.
- 40:32Right.
- 40:32Because the rich people, rich people can just retire.
- 40:34Right.
- 40:34You could retire at 50.
- 40:36You probably already did.
- 40:37Right.
- 40:37It's the poor people that are still going to have to work until like 70 now.
- 40:41And and then what die at like 72.
- 40:44Right.
- 40:44Like.
- 40:45You know, hundred.
- 40:46No, it's a really, it's a really important point about how a lot of this very fundamental science research.
- 40:53historically, especially in the United States, has both informed like military and intelligence posture as well as policy-making posture.
- 41:00That's right, yeah.
- 41:01And there's just been this disconnect where for whatever reason, there's no longer the through lines from fundamental research and the insights that are gleaned from that into bleeding into these areas that are in the control of nation states in terms of how do you sort of organize society around it.
- 41:22Yeah, dude.
- 41:22This is like a meaningful and important point because people do still generally do still think like, oh, yeah, we're just going to live longer than our parents.
- 41:31Much like every other aspect, at least in the U.S. of life, right?
- 41:34We are less like the millennials and younger.
- 41:37Yeah.
- 41:37We're less well off financially than our parents.
- 41:39Yeah.
- 41:39Everything is less affordable than it has been for our parents.
- 41:42And we're the first generation.
- 41:45to be less well off than our parents.
- 41:47And so the idea that we're going to also now live just as long makes it like you can kind of see like all these things are like aligning.
- 41:55Yeah.
- 41:55And then and then when they when when, you know, our parents generation retires,
- 42:00The population pyramid is now basically inverted for all of these developing countries where this is true.
- 42:05Right.
- 42:06The Japan problem.
- 42:06Right.
- 42:07Like it's it's now there's fewer and fewer young people to support this older population for Social Security.
- 42:13Turns out, given that population pyramid and the mathematics of just two plus two equals four and it's never five.
- 42:20Right.
- 42:20Like this might just be a scam.
- 42:23Compound on top of that.
- 42:24Right.
- 42:24This idea that like actually the fundamental premise that like the younger generation is going to live longer.
- 42:30Yes.
- 42:30And so can contribute more.
- 42:32Right.
- 42:33To the social security pile.
- 42:34Yes.
- 42:35Is now no longer correct.
- 42:36Right.
- 42:36And we need to start asking questions like is this like it's there's a fundamental shift now I think in my mind from is this a tenable strategy.
- 42:46Right.
- 42:46To is this even a correct way to do business in a developed society.
- 42:51Right.
- 42:52Right.
- 42:52Right.
- 42:52Right.
- 42:52I don't want to sound communist because I swear I am not a communist.
- 42:57Okay.
- 42:57But like at some point you got to start asking questions about fundamental things like the social construct.
- 43:05Right.
- 43:06Like is social contract.
- 43:08Sorry.
- 43:08Yes.
- 43:08Like, you know, is this true?
- 43:10Like this is the social contract of.
- 43:13the post-war era still applicable today.
- 43:16Right.
- 43:17And the fundamental variables in that equation have changed so drastically.
- 43:21And we're still saying the outcomes are going to be the same, even though all the variables on the other side of the equation are fundamentally very, very different.
- 43:29Yeah, yeah.
- 43:29Like, this is a reality now, and it's, like, going to catch up with us as we grow older.
- 43:33Yeah.
- 43:33This is a really, really important story.
- 43:35I'm sure we're going to come back to the subject of longevity because I think the nexus you brought up from longevity studies to policy is a really important note, especially when we're seeing not only in Western, let's say, quote-unquote, Western developed nations, but any developed nation, this similar issue of generational friction that arises from 50-year-old to 80-year-old people.
- 44:02policy conceptions that are based on fundamentals that are now statistically, data wise and scientifically are proving to not necessarily be the same.
- 44:14And yet we've not changed any of our posture.
- 44:18Yeah, yeah, yeah.
- 44:18And then we're just going to run into a brick wall at some point.
- 44:20And this is it's a problem.
- 44:22Yeah.
- 44:23Yang gang.
- 44:24Yeah.
- 44:28It's interesting because it does dovetail somewhat to our third story.
- 44:31One aspect we didn't talk about the factors of longevity that changes, you know, climate is a big part of that.
- 44:38It's getting bad.
- 44:39And our next story is about a new no-sort plastic recycling being near.
- 44:44The headline, New Nickel Catalyst Enables No-Sort Mixed Plastic Recycling.
- 44:51This is a new, brand new breaking research coming out of Northwestern University.
- 44:56They put their paper out in Nature Chemistry.
- 44:59Yeah.
- 45:00I just went to Japan earlier this year, and one of the interesting things about in Japan, unlike in the US, is they have different recycling bins for different types of recycling, glass, cardboard, et cetera.
- 45:09In the US, we just put it all in the same thing.
- 45:11So my assumption is this no-sort plastic is saying like there's no need to,
- 45:18X, Y, Z.
- 45:19This seems like it's on the sort of pollution and our need to be more effective with our resource users.
- 45:26This might have impact.
- 45:28But tell me what we need to know about this story.
- 45:29Yeah.
- 45:30Plastic.
- 45:31We love it.
- 45:31Yes, we do love it.
- 45:32We do love it.
- 45:33As humans, we are cheap.
- 45:36And we want things.
- 45:39We want things to be easy.
- 45:41We want them to be cheap.
- 45:43And so we love plastic.
- 45:45Okay.
- 45:45Plastic is really bad for the environment.
- 45:49It sticks around for like millions of years or something like that.
- 45:52Right.
- 45:53And we are producing a lot of it.
- 45:55Something like 400 million tons a year.
- 45:59Something like 11 million tons go into the ocean.
- 46:03Which, you know, I'm very...
- 46:06I really don't like that.
- 46:07Okay.
- 46:08But I'm also a lazy, selfish American.
- 46:12And...
- 46:15I like my things, right?
- 46:18I like my mustard and ketchup bottles in plastic and my milk jug that comes in a gallon in plastic.
- 46:25I don't want to go with a glass bottle and refill the same milk jug.
- 46:29It's just so convenient to just go to the store and grab a new thing and then throw away the old one and just not worry about what the old one is doing, right?
- 46:38So as Americans, we are very selfish and we're very lazy.
- 46:43And, you know, it's not just something that Americans are.
- 46:46It's something that the whole world is.
- 46:48This is a world problem.
- 46:50And, you know, everyone who says that, like, we need to start using less.
- 46:55It's just simply not a practical way to save the planet.
- 47:01Okay?
- 47:02Mm-hmm.
- 47:02Like, we love our planet, but we love ourselves and our comfort way more.
- 47:07And that is just not going to change.
- 47:08Okay?
- 47:09Even the developing, especially the developing countries, right?
- 47:13Like China and India and the continent of Africa that are...
- 47:18also contributing immensely to this chaos of plastic and consumables and all this stuff.
- 47:23They're looking at the developed countries being like, no, you guys did that.
- 47:26Well, you guys just had 50 years of doing that.
- 47:29And now we're just starting.
- 47:30And now it's like, oh, I'm sorry.
- 47:32I can't use coal.
- 47:34You know, when that's the one resource that's super cheap to use to make electricity, which is something I need so I can like educate my kids.
- 47:41Yeah.
- 47:42So this idea that like, you know, using humans doing less to save the planet is not going to work.
- 47:49Yeah.
- 47:49Okay.
- 47:50The solution that is going to work is scientific innovation to make our current lifestyle better for the planet.
- 47:57And more sustainable.
- 47:57More sustainable for the planet.
- 47:59I know this is a hot take.
- 48:00I know.
- 48:01About like how we need to deal with human directed climate change because it is real.
- 48:06Right.
- 48:06Humans are changing the planet.
- 48:07Yes.
- 48:08But my fundamental take is like we're not going to stop.
- 48:11I mean, at the end of the day, the idea that, you know, people using paper straws instead of plastic.
- 48:18But then every corporation and manufacturing entity and these large people who are actually producing the largest volume of the problem is really where the problem is.
- 48:30Yeah, yeah.
- 48:31Exactly.
- 48:31In terms of having the most impact for our efforts.
- 48:34Yes, yes.
- 48:34We need a bulk strategy.
- 48:36Right.
- 48:37Because even if you made every human, like individual human, like feel bad, corporations who are apparently also people –
- 48:46They're not going to feel bad because the mob is crazy, right?
- 48:49No, exactly.
- 48:50And so, no, they're going to be like, oh, yeah, just dump it right there.
- 48:53It's fine.
- 48:53Exactly.
- 48:53You know?
- 48:54So we need a strategy from fundamental science perspective that helps us recycle efficiently and in a better way.
- 49:01Yes.
- 49:01Okay?
- 49:01Plastic recycling is a key problem that we as humans, I think we need to solve.
- 49:06Yes.
- 49:06Okay?
- 49:07And this is a really big step in that direction.
- 49:09Okay.
- 49:10Okay?
- 49:10Okay.
- 49:10So let's talk about plastic.
- 49:11Plastic is really bad.
- 49:12I just told you like something like 11 million tons go into the ocean every year.
- 49:17It's going to just stay there for thousands of years.
- 49:19It's not going to decompose.
- 49:20Plastic is essentially chemically.
- 49:23It's just polymer chains of hydrocarbon.
- 49:26So carbon, hydrogen, hydrogen, hydrogen, carbon, hydrogen, hydrogen, hydrogen, just chains of carbon and hydrogen.
- 49:32Okay.
- 49:33Like that's all plastic is.
- 49:34It comes from like petroleum, which is also hydrocarbons.
- 49:39So another like, you know, it's another use of petroleum in that case.
- 49:44And in order to recycle it, there's basically like a few ways that we do it right now.
- 49:48And they're all pretty bad.
- 49:50Okay.
- 49:50One of them is the thermomechanical method, which is what you got to do is you got to basically materially degrade this thing.
- 50:00You've got to like heat it up.
- 50:02You've got to make it into like lower, worse plastic and then use that plastic somehow for some other purpose.
- 50:10Okay.
- 50:10It's a pretty bad way of doing things.
- 50:13But we do it 9%.
- 50:149% of the plastic globally is done this way.
- 50:18It's really expensive.
- 50:19Nobody really wants to do it because you've got to sort all these plastics for all their different types of plastic.
- 50:26Right.
- 50:27Because they break down to different fundamental parts and you don't necessarily want those mixed.
- 50:30Yeah.
- 50:30And then if they mix, then they make even worse stuff.
- 50:34And then they just go to the landfill.
- 50:35And it's like, okay, what did you even do?
- 50:37We just wasted a bunch of money.
- 50:38You just, yeah.
- 50:40So that's one way.
- 50:41The other way is pyrolysis, which is just heat it up.
- 50:46Heat it up, degrade this thing.
- 50:47And then you get some kind of low value type of GHG, which is like some kind of like low value fuel.
- 50:56Right?
- 50:56The problem with that is, okay, fine.
- 50:57Like, how much energy did you use to, like, heat this thing up?
- 51:01To get a low value fuel.
- 51:03You're getting, it's like nuclear fusion, right?
- 51:06It's like, why are you even doing that?
- 51:07You're putting more energy in to actually get, like, some kind of fuel out.
- 51:11Right.
- 51:12On top of that, if oil prices are super cheap, then, like, why would you even do this?
- 51:16Right.
- 51:16Right.
- 51:16So...
- 51:20And whenever you're doing anything like this, there's also all of these contaminations that happen, right?
- 51:26Because plastic has like food products.
- 51:28Sometimes they have PVC, which is polyvinyl chloride.
- 51:32And if that gets in here and as it's degrading, so this polyvinyl chloride, it's found in like pipes, flooring.
- 51:39And if that gets in there, even in a batch, a small thing in a huge batch, right?
- 51:44That whole batch is done because you get this hydrochloric acid.
- 51:48All the equipment is done.
- 51:50And at the end of the day, you're dumping it into the landfill anyway.
- 51:53Okay.
- 51:53So it's really kind of bad.
- 51:56We have a lot of bad options.
- 51:58We have really a lot of bad options.
- 52:00The only good option is to take the plastic.
- 52:02Usually it's in this thing called polyolefin, which is a CH2.
- 52:08Carbon, two hydrogens attached to a C and a H and then some other thing in our group, a residual group.
- 52:16Those are the things that are basically two thirds of the global plastic chain.
- 52:22This is like, you know, your milk cartons and plastic spoons and like plastic wrap.
- 52:27and all this other kind of stuff.
- 52:30Single use, really short lifespan, just gets used, gets thrown.
- 52:35Okay?
- 52:35That's what we're trying to, at the end, ultimately, we're trying to recycle.
- 52:40We're trying to repeal and replace it.
- 52:42Yeah.
- 52:43Yes, exactly.
- 52:44And what I just told you, right, the options are pretty bad.
- 52:48Right.
- 52:48Okay?
- 52:49There's one option that has a little bit of hope.
- 52:53And that is this thing called hydrogenolysis.
- 52:59It's basically breaking it down in the presence of hydrogen.
- 53:04And what it does is the hydrogen sort of comes in along with some kind of catalyst that helps this reaction.
- 53:10And that hydrogen comes in and with the carbons and the hydrogens there, it creates hydrocarbons.
- 53:16Okay.
- 53:16that can then be used for either fuel or like waxes or like these higher sort of lubricants, things like that that you can recycle them to, right?
- 53:27So that's one way of doing things.
- 53:29That's like kind of a promising way of like recycling this plastic and...
- 53:35putting it back into simple hydrocarbons, right?
- 53:37And that's something that's like much less worse for the environment, right?
- 53:41Like animals aren't choking on it and shit like that.
- 53:44So that's what we want to do.
- 53:45Now, usually this hydrogenolysis takes catalysts, and those catalysts require like higher order elements, rare earth elements like platinum, palladium,
- 53:58We don't got a lot of that stuff.
- 53:59Like, the amount of plastic we got compared to the amount of platinum and palladium.
- 54:03Like, this is the stuff that Iron Man used to make his, like, new element.
- 54:08Okay?
- 54:08So, that's how rare it was that Marvel was using it in a movie.
- 54:11So, we can't be dependent on platinum and palladium to, like, recycle...
- 54:18the tons and tons of plastic right how many mines we gonna get right so so the idea is you want you want to have a catalyst that is not that rare that's what this team is doing this okay this this fundamentally okay yes fundamentally they're they they found a way to catal catalyze hydrogenolysis using a catalyst made out of nickel which is very abundant and
- 54:43Furthermore, this catalysis only targets a specific type of this polyolefin.
- 54:50Okay?
- 54:50Because as I said, this is the CH2, CH2, right?
- 54:53And then there's the R group.
- 54:54That R group can be sometimes H, which makes it polyethylene.
- 54:58Or it can be sometimes polypropylene, which is the other group is another complex thing, like another CH2.
- 55:06So you get these like, with polyethylene, you just get this chain of carbons with hydrogens attached.
- 55:11Yes.
- 55:11Like a caterpillar.
- 55:12Yes.
- 55:13Or you get for polypropylene, you get the chain of carbons with carbon sticking out.
- 55:19Yep.
- 55:19Okay?
- 55:20And so what you want to do is you don't want to recycle these together.
- 55:25Okay.
- 55:26And usually that requires separation.
- 55:28And that's really, really just a pain.
- 55:31Yeah, yeah, yeah.
- 55:32Yeah.
- 55:32All right.
- 55:32Nobody wants to do this.
- 55:33Both time and cost prohibitive.
- 55:34Both time and cost prohibitive.
- 55:36And more importantly, it's cost prohibitive, right?
- 55:38And the consumer is not going to do it because, again, we're lazy.
- 55:41Yeah, yeah.
- 55:41We don't want to do that.
- 55:43Yes, I love the earth, but I don't want to check under the bottle what kind of plastic it is before I throw it in the garbage.
- 55:50This goes back to the sorting issue, which is like, ideally, this is why you want to have the humans who have the products put it into different buckets so that when it gets to the facility to recycle, it is pre-sorted.
- 56:01Yeah.
- 56:02But yeah.
- 56:03And it's like, even if you got the humans to do it, though...
- 56:07Do you really trust that human?
- 56:08That's the point.
- 56:09Like, I don't know if this human can read.
- 56:12Right.
- 56:12Right.
- 56:13So it's like, I don't know.
- 56:14Right.
- 56:15So you would rather have a way of doing it within the chemical reaction.
- 56:20Right.
- 56:20That targets one type of plastic and not the other.
- 56:23Right.
- 56:23And that's what this thing is doing.
- 56:25So they developed a catalyst out of nickel.
- 56:28It's got aluminum, nickel.
- 56:30the usual carbon and all this other kind of stuff.
- 56:32And one of the cool things they did was this catalyst, you can imagine it as, again, a Lego block, okay?
- 56:39But this Lego block has only a single piece of, like, active site, okay?
- 56:46Okay.
- 56:46Whenever you have a catalyst, you have something called an active site, which is the part that does the locking and the moving around of the atoms, okay?
- 56:55This thing has a single active site, okay?
- 56:58And what that gives it is...
- 57:00the benefit of being extremely specific to what shape it wants to actually attach to, right?
- 57:08A lot of catalysts have different shapes, which means that when you try to put it into something like polypropylene or polyethylene, they're going to attack every single carbon-carbon bond, okay?
- 57:17And then you're going to get a bunch of methane, which is fine, I guess, but like it's not like great.
- 57:22Methane is like super cheap.
- 57:23It's like this low-
- 57:24What you'd like to do is with polypropylene, I told you, right, there's these carbon and then there's these carbons that are sticking out.
- 57:30You want to just take out the carbon that's sticking out.
- 57:33And then this thing just becomes like polyethylene.
- 57:36And then you can then do those two together in some other sort of process.
- 57:41So you want to take those out and then only target specific bonds.
- 57:46And that's what this new catalyst does.
- 57:48Very, very clever.
- 57:49So it's doing the sorting within the chemistry.
- 57:52At the facility where they're going to be doing the recycling, regardless of the input,
- 57:57The chemical process itself is doing the job of separation.
- 58:04Exactly.
- 58:04That we otherwise are, in some cases, in some places, depending on humans, to put things in different buckets.
- 58:10Yeah, exactly.
- 58:11And the results are, they speak for themselves.
- 58:14So they tested this catalyst with isotactic polypropylene, which is this thing that I was telling you about with the branches coming out.
- 58:23And 99.5% conversion.
- 58:25into lighter compounds in 20 minutes.
- 58:28And then when they did the same thing, they did the same thing with the polyethylene.
- 58:34Yes.
- 58:35Nothing happened.
- 58:37Right?
- 58:37Yes.
- 58:38And it took four hours.
- 58:39Yeah.
- 58:40And then they finally got a little bit of signal.
- 58:42So what you can do is you can have a mixture of this stuff.
- 58:44You can apply this catalyst.
- 58:45Yes.
- 58:45And then you can just let it run.
- 58:48Yes.
- 58:48And then within a short amount of time, all the polypropylene will be,
- 58:52decomposed, but the polyethylene will be in this native state, and then you can go forward.
- 58:56And now you have these two buckets of distilled compounds that you then have functional use for in any number of other downstream or upstream, depending on what way you want to look at it, industrial processes.
- 59:07That's right, yeah.
- 59:08And then the best part was that, you know that PVC that I was talking about?
- 59:11Yes.
- 59:11The polyvinyl chloride, which is a contaminant for all of these plastics, that basically makes plastic unrecyclable in these previous strategies?
- 59:20Yes.
- 59:22Somehow, and I don't think they fully understand how this works.
- 59:25We love that.
- 59:25This made it better.
- 59:27Really?
- 59:27Yeah.
- 59:28The introduction of PVC made the catalysis reaction better.
- 59:32No friggin' way.
- 59:35Yeah.
- 59:35So then they were like, oh, that's free.
- 59:37That's great.
- 59:38Just like free upside.
- 59:39It's like, oh, that's great.
- 59:40Yeah.
- 59:41Which then removes the cross-contamination issue.
- 59:44Yeah.
- 59:44Which goes back to this no sort.
- 59:46Like, yeah.
- 59:47So then we don't have to sort it.
- 59:48We don't even have to worry about the PVC.
- 59:49The PVC could be in there and it's just going to make it better.
- 59:51Yeah.
- 59:52It's just like fine.
- 59:53So I think this is a really cool use of like fundamental chemistry to try to like tackle a very, very real problem.
- 1:00:01This is really good.
- 1:00:02That's actually a great explanation because I actually had no context for how the recycling process really worked.
- 1:00:09Yeah, I didn't either until I started researching this.
- 1:00:11And this is like a clear like it's a clear problem set.
- 1:00:14We don't have good solutions currently implemented at scale.
- 1:00:17No.
- 1:00:18And we.
- 1:00:19But it's something that I really do care about.
- 1:00:21Right.
- 1:00:21Just, you know.
- 1:00:22Right.
- 1:00:22But do it at the factory.
- 1:00:23Yeah.
- 1:00:24Yeah.
- 1:00:26I'm lazy.
- 1:00:26I'm sorry.
- 1:00:27As are the majority.
- 1:00:29Again, it also should not be incumbent.
- 1:00:32The commons is a concept.
- 1:00:33We all should invest in the commons and trying to upkeep.
- 1:00:37But at the end of the day, the biggest kind of issue is the industrial grade, industrial level.
- 1:00:42Exactly.
- 1:00:43It's hard for me to do anything.
- 1:00:47And we have to address it at that level.
- 1:00:48And one of the ways you can do so is when they bring the stuff to the facility, it can actually repurpose it in a way that creates...
- 1:00:54functional, valuable output that is not the current state of affairs where it's either the output sucks and we wasted a bunch of energy, time, and money.
- 1:01:04Yeah.
- 1:01:05Or it just went to the landfill.
- 1:01:06It just went to the landfill anyway.
- 1:01:08Or the output doesn't have real value in terms of the concept of recycling it back into society.
- 1:01:15Exactly, yeah.
- 1:01:16And your point about the commons, I think, is important, right?
- 1:01:19There is a commons that I am heavily invested in.
- 1:01:22I pay taxes, and I want those commons, my tax dollars, to go into this kind of research.
- 1:01:27Because that is the future of saving this planet.
- 1:01:30Saving the planet is not making humans somehow be less comfortable, okay?
- 1:01:36That's not going to work.
- 1:01:38I know humans.
- 1:01:39I know several humans.
- 1:01:40They're all like me, okay?
- 1:01:43And what we want is solutions that actually make sense, that don't compromise my state of life.
- 1:01:51And yeah, we need fundamental science research to do this.
- 1:01:56I think we've had enough innovation on our mobile phones.
- 1:01:58Yeah, I'm totally fine.
- 1:02:00Yeah, with the current state of my iPhone, it's sufficient.
- 1:02:03Maybe let's not try to iterate on an incremental version for next year and spend that brain power, time, and energy.
- 1:02:10on things that will create a better commons environment, which then drives the consumerism that capitalism loves.
- 1:02:17Great, great story.
- 1:02:18Yeah, I like the story.
- 1:02:20Speaking of the private sector and multi-trillion dollar companies, we're going to end today with a story about analog AI coming out of Microsoft.
- 1:02:29We almost cannot avoid AI every week.
- 1:02:32Nope.
- 1:02:32Headline on the story, Microsoft's analog optical computer cracks two practical problems and shows AI promise.
- 1:02:40This was published on Microsoft News' blog.
- 1:02:42But they did put out a research paper associated with this in nature.
- 1:02:47So it's not just marketing.
- 1:02:49They did sort of go through the peer review.
- 1:02:52And so I don't really actually even understand what they mean when they say analog optical computer.
- 1:02:57Yeah.
- 1:02:58And there's several problems to crack, but they cracked two of them.
- 1:03:00So let me know.
- 1:03:01What are we talking about here?
- 1:03:02That's right.
- 1:03:04It's an analog computer instead of a digital one, which is very cool to me.
- 1:03:09Digital, you got your zeros and ones, right?
- 1:03:13And we talked a lot about digital computers in the past and some of their problems, right?
- 1:03:17The fact that Moore's Law is slowing down because we're sort of reaching this limit of
- 1:03:23of how small we can go before the capacitors and the transistors that we're using start leaking off so much power that we just have to constantly keep powering it in order for the data to actually stay alive.
- 1:03:35We also talked about the von Neumann gap, right?
- 1:03:40The von Neumann bottleneck, which is the separation between your processor and the memory there, which is your RAM,
- 1:03:49and your hard disk or your actual memory yes right and the where you're storing stuff is different from where you are doing the computation yes right this is a thing that plagues cpus but it also plagues gpus okay and um as ai becomes increasingly big
- 1:04:11There's going to come a point where we're going to really have to start having the conversation of, again, you know, what we were talking about last in the last story.
- 1:04:20Is this worth the environmental impact?
- 1:04:23Right.
- 1:04:23Right.
- 1:04:24And of course, the corporations are going to be like, yes.
- 1:04:26And they're going to make bigger and bigger data centers.
- 1:04:29For example, the energy usage has tripled from 2014 to 2023.
- 1:04:33And it's projected to be 20% of global electricity by 2030.
- 1:04:39Okay, the data centers and the AI, all that AI computations for you making a cat that wears a hat or whatever.
- 1:04:47Like that's 20% of global electricity.
- 1:04:50Now, I'm not saying that we shouldn't be using AI.
- 1:04:52Like because I use AI, AI is great.
- 1:04:56But I think all of these companies, including Microsoft, are starting to realize that it's no longer going to become tenable, right?
- 1:05:04100%.
- 1:05:06there needs to be an alternative way to do the computation that they are seeking.
- 1:05:11I'll just make a brief note here, which is that every single one of the either Frontier Model Builders
- 1:05:20or sort of hyperscaler cloud computing platforms, Google Cloud Product, AWS, they're all spending a ton of their capital on directly investing into power infrastructure.
- 1:05:37Yeah, because they know that that's going to be a bottleneck.
- 1:05:40Every single hyperscaler or frontier model company is investing, if not hundreds of millions, billions of dollars in...
- 1:05:48into partnerships with these mini nuclear reactor companies.
- 1:05:53They're literally returning on the big power facility that's just north of us in California.
- 1:05:58The nuclear one, Facebook has a little alcove there.
- 1:06:01So they all know the story.
- 1:06:03Yeah.
- 1:06:03Like it's not.
- 1:06:04They see it.
- 1:06:04They see the writing on the wall.
- 1:06:05It's not controversial for any of them.
- 1:06:07Yeah.
- 1:06:08And on top of that, there's a bunch of these companies that are investing in alternative computing technology, right?
- 1:06:14100%.
- 1:06:15Like we were talking about Spintronics the other day.
- 1:06:17Yes.
- 1:06:18This is an analog computer.
- 1:06:20It's doing sort of the same type of deal.
- 1:06:22Not the same physics, but the same sense of let's go away from transistors and physical stuff.
- 1:06:31And let's try to find a different, completely different way to store data and manipulate data.
- 1:06:36Okay.
- 1:06:36Okay.
- 1:06:38If we go back to the von Neumann bottleneck, right, from John von Neumann, he championed this idea of that early computer where there was going to be a separation between the processor and memory, right?
- 1:06:49That's become sort of the bedrock for modern computation.
- 1:06:53But it's really become a huge handicap for AI, okay?
- 1:06:59Because when we want to do AI, there's two core operations that we have to do.
- 1:07:03OK, one is matrix multiplication, right, where we take the weights of your neural network and you multiply it by some vector and then you multiply by another matrix and another matrix.
- 1:07:15And all of these are weights that you've stored.
- 1:07:18And the other thing that you have to do is you have to do a nonlinearity, which is this idea that if if my input is above a certain threshold, only then do I let it through.
- 1:07:29If it's below a certain threshold, then it's a zero.
- 1:07:31Okay.
- 1:07:33That's one of the types of non-linearity that you have to do.
- 1:07:35Those are the two fundamental things that you have to do as someone who wants to implement a neural network.
- 1:07:41Okay.
- 1:07:42Then there's other things like momentum and annealing and all this other stuff that you have to do.
- 1:07:46But fundamentally, if you really want to do neural network stuff, it's matrix multiplication and implementing a non-linearity.
- 1:07:53Okay, so now in order to do these things in a traditional computer, what you have to do is you have to store your weights in a certain spot, okay?
- 1:08:01And then you got to load them up in your processor.
- 1:08:03Right.
- 1:08:03And then you got to multiply the weights to this thing.
- 1:08:07And then you got to load up new weights.
- 1:08:08And then you got to multiply to this thing.
- 1:08:10And, you know, now we've gotten clever where maybe we can load up all of the weights to this thing and, you know, do a forward pass and things like that.
- 1:08:18But fundamentally, a lot of the source of latency that comes from like you waiting while you've typed something into ChatGPT and it's like thinking is doing this, right?
- 1:08:28It's like loading up.
- 1:08:30And then there's like copper wires in whatever server that is like transferring data.
- 1:08:36And the latency is a huge part of it too, right?
- 1:08:39So there's a lot of power that's being dissipated for no reason.
- 1:08:42And then there's also a lot of latency.
- 1:08:44This thing is solving both of those.
- 1:08:45That's very interesting.
- 1:08:46Okay.
- 1:08:47This thing is solving both of those by creating a computer out of light, lenses, and filters.
- 1:08:54Very interesting.
- 1:08:55Okay?
- 1:08:55Okay.
- 1:08:55It's very cool to me.
- 1:08:56Yeah, yeah, yeah.
- 1:08:57Because it's like fundamental physics used in a whole new way.
- 1:09:00Okay.
- 1:09:01Okay?
- 1:09:02So, to understand this, let's look at the two things that we need to do in order to do a neural network implementation.
- 1:09:11Okay?
- 1:09:12The first one I talked about was matrix multiplication.
- 1:09:14Okay?
- 1:09:14That's this idea of you take a vector of numbers, which is, let's say, a row of numbers, and then you apply a matrix to it.
- 1:09:20So this this number gets applied, gets multiplied to all of these.
- 1:09:24This number gets multiplied to all of these.
- 1:09:26And then you sum it up and you get a new vector, kind of like things like that.
- 1:09:28Right.
- 1:09:30What these guys figured is.
- 1:09:33We could do that with like light and filters.
- 1:09:37Okay.
- 1:09:38Okay.
- 1:09:39So the vector is an array of numbers, right?
- 1:09:42We could represent that with the brightness of LEDs.
- 1:09:48Do you see where I'm going now with the whole thing?
- 1:09:50I already see where you're going.
- 1:09:51Okay.
- 1:09:51I could represent that with a brightness of LEDs.
- 1:09:54Okay.
- 1:09:55Then I've got a matrix that I need to multiply it with, right?
- 1:09:59I could represent that with a bunch of filters.
- 1:10:01Oh, no.
- 1:10:02Right?
- 1:10:03That each light goes through.
- 1:10:04I'm so mad.
- 1:10:06It's so nice.
- 1:10:06Yeah.
- 1:10:07It's so nice.
- 1:10:08Right?
- 1:10:09And then I've got an output vector, right?
- 1:10:12That output vector could be a CCD that senses how much light went through.
- 1:10:19Okay?
- 1:10:20So completely analog.
- 1:10:22Right.
- 1:10:22Right.
- 1:10:23Right?
- 1:10:23There's no zeros and ones.
- 1:10:25It's like something, there's a continuous value here of the brightness, there's a continuous value of the filters, and then there's a CCD that captures whatever comes out.
- 1:10:34Right?
- 1:10:34And then now, okay, the second thing I have to do is implement a nonlinearity.
- 1:10:37Right?
- 1:10:37In order to implement the nonlinearity, they've got...
- 1:10:40like a bunch of filters that they can use, like the bipolar difference filter.
- 1:10:44So they've got, so now they've got these CCDs, right?
- 1:10:46That converts it into current.
- 1:10:47The current now goes through analog.
- 1:10:49It's still analog.
- 1:10:51A lot of these implementations, what they've done is they've done a hybrid approach of digital and analog.
- 1:10:55This is all analog.
- 1:10:57Pure analog, it's wonderful.
- 1:10:59You got these, you got the light that's coming out like this.
- 1:11:03It is now going to go through this sort of filter block.
- 1:11:06Okay.
- 1:11:06It's going to go through a bipolar differential pair, which is going to do the non-linearity.
- 1:11:11So if the light, if the current is below a certain amount, it's going to give it zero.
- 1:11:16But if it's above a certain amount, then it's going to let through a bunch of current.
- 1:11:19You also want to do this thing called annealing, which is this idea of like...
- 1:11:24Taking the current representation and sort of changing it a tiny bit so that you don't get stuck in like a state of the neural network where you're not like moving and you're getting the wrong answer, so to speak.
- 1:11:37So you can do that using these things called variable gain amplifiers.
- 1:11:41Which are VGAs used a lot all over tech.
- 1:11:45You can also do this thing called momentum, which is something that you use in neural networks.
- 1:11:49If you're like converging on an answer, you want to keep going in that direction.
- 1:11:53That's something that you can implement with VGAs, which is, again, something that everybody uses.
- 1:11:58And then you can feed it back into the thing and have this loop.
- 1:12:02Now, this is a fundamentally different architecture, not just for the physics of it, right?
- 1:12:07Because we're not using GPUs.
- 1:12:08We're using light and matrices.
- 1:12:10Right.
- 1:12:11in the form of filters and things like that.
- 1:12:12But also you can imagine it as like, there's a single sort of neural network that we're like passing over and over again.
- 1:12:19Right.
- 1:12:20So what these things are implementing is something called deep equilibrium models.
- 1:12:25There are different types of neural network where you've got a neural network and instead of a forward pass that gives you a right answer, what these models do is they call the model over and over again,
- 1:12:37until the model doesn't change its output.
- 1:12:43So what it's doing is, it's in the space and it's going down, kind of like a gradient descent algorithm, where it's going down this sort of energy landscape, until it gets to this minima, where as it moves, it's not really moving anywhere.
- 1:12:55Before it was moving here, then it's moving here, it's trying to find the answer.
- 1:12:58But once it gets to the answer,
- 1:13:00the more you apply it all the way to infinity, it's not really going to move.
- 1:13:04Right.
- 1:13:04Right.
- 1:13:05That's what this thing is doing.
- 1:13:06The problem with deep equilibrium models on GPUs was, it was like extremely, like how many times am I going to, right.
- 1:13:13But this, the physics itself is geared towards these deep equilibrium models.
- 1:13:18Yes.
- 1:13:18Right.
- 1:13:19And so you've got this, you've got this entire like system that is a digital analog.
- 1:13:27I mean, sorry, it's an analog computer.
- 1:13:30Right.
- 1:13:30Right.
- 1:13:31Right.
- 1:13:31Which is which is, I think, very cool.
- 1:13:33And because part of the this goes back to like the energy and cost issue with, you know, GPUs are both expensive on their face to produce at the scale we need to to do these like chain of thought reasoning level models, these frontier models.
- 1:13:47And then the power usage, not only to acquire the physical hardware is cost prohibitive, but then to run them to be able to get to that level is also cost prohibitive.
- 1:13:58And this sort of solves both issues.
- 1:14:01Again, accounting for the fact that this is obviously not an industrial manufacturing scale and all these other things.
- 1:14:08This is not industrial manufacturing, but they're not using like crazy tech.
- 1:14:12That's okay.
- 1:14:13They're using LEDs.
- 1:14:15They're using the matrix that they use for the multiplication.
- 1:14:18That's just like the filter in your projector.
- 1:14:20That's very interesting.
- 1:14:21Okay.
- 1:14:22And then the CCD is like the sensor in your phone.
- 1:14:25And then you got VGAs, which everybody knows how to, like everybody has.
- 1:14:29We know how to make it super cheap at this point.
- 1:14:31You don't need like an insane fab to do any of this stuff.
- 1:14:35Which this becomes very interesting because of the, I mean, there's so many implications here, not only from just from the fundamental perspective, but if you extrapolate both like geopolitically and economically.
- 1:14:46You know, one of the issues with the whole AI debate is NVIDIA has now become a trillion dollar company in record speed because they're the only ones that can build these chips, these GPUs, sorry, these GPUs that can really run the frontier models effectively.
- 1:15:02And to be able to get to NVIDIA scale because of the complexity of the manufacturing process and the amount of proprietary knowledge necessary.
- 1:15:09There's like no IBM has tried.
- 1:15:11They can't.
- 1:15:12And there's no one else.
- 1:15:13Yeah, because they've done 20 years of work to get to where they are.
- 1:15:17Right.
- 1:15:17Right.
- 1:15:17And what's interesting is it sort of upsets the apple cart in the sense of if there is a low cost, high efficacy hardware substrate.
- 1:15:28that you can utilize to do the same type of work that you're seeing out of a GT5.
- 1:15:33Faster, cheaper, with less power.
- 1:15:36Like one caveat is this thing is only going to work for inference.
- 1:15:40Okay.
- 1:15:40It's not for training.
- 1:15:41Which is... Because in training, you'd have to change the weights and things like that, right?
- 1:15:45So in order to train, what they did was they created a digital twin, which they then trained.
- 1:15:50Yep.
- 1:15:50And the digital twin matched the hardware's... Yep.
- 1:15:53Performance.
- 1:15:54So then when the digital twin said, okay, you want to set your filters this way and you want to set your nonlinearities this way, they could go and implement that with the hardware and then they could like do the inference time stuff on this.
- 1:16:06But to be fair, like all of the...
- 1:16:10Like the reason why all of these companies are building all of these data centers is not to train.
- 1:16:15It's for inference.
- 1:16:16It's for inference, right?
- 1:16:17The training happens in like San Francisco in their facility or, you know, whatever.
- 1:16:22In like some like tiny, like the hundreds of millions of users of ChatGPT and Gemini are just using it for inference.
- 1:16:29It's all inference.
- 1:16:29I was going to say like where the usage is going.
- 1:16:32Like the power is going for inference.
- 1:16:34Correct.
- 1:16:34As more users start using, you know, LLMs and other versions of AI in everyday life, and we get to the order of billions, billions, billions of users doing so, what they're using is the inference.
- 1:16:47And so this can be a whole – you can still have your proprietary training stacks with all these fancy GPUs and all that stuff.
- 1:16:54But now you don't need to have that high-cost infrastructure.
- 1:16:57in order to serve the end user of the models.
- 1:17:00Yeah, and if you can miniaturize this thing, then you're good to go.
- 1:17:05I mean, again, we're extrapolating here, but you can imagine I have my own little analog.
- 1:17:08Yeah, yeah, and it's just, and the great thing is this uses LEDs, it's not using lasers.
- 1:17:13Right.
- 1:17:14So I don't need coherent light.
- 1:17:15This is just like normal LEDs.
- 1:17:17So that's so clever.
- 1:17:19Yeah, that's so I love.
- 1:17:20I love that.
- 1:17:21Yeah, I think I think they did a really good job.
- 1:17:23I quite like it.
- 1:17:24Creativity is alive and well.
- 1:17:26Yeah.
- 1:17:26Fundamental science research.
- 1:17:28One of the ways you get breakthroughs is by being creative.
- 1:17:31Yeah.
- 1:17:31Dogmatic.
- 1:17:32Yeah.
- 1:17:32Um.
- 1:17:33That is really, really.
- 1:17:35Yeah.
- 1:17:36Coming from the tech space, this obviously.
- 1:17:37Yeah.
- 1:17:37And then my light bulbs are going off.
- 1:17:39Yeah, dude.
- 1:17:40And it's like 20 nanoseconds per search per iteration of this thing.
- 1:17:46The idea is called a fixed point search because you're searching for a fixed point to get to the answer, right?
- 1:17:51What I was telling you earlier about.
- 1:17:54Yes.
- 1:17:54Yeah.
- 1:17:5520 nanoseconds per fixed point search.
- 1:17:57And this thing is projected to be 100 times more efficient than leading GPUs.
- 1:18:03Going at 4.5 tera operations per second per watt.
- 1:18:07Right?
- 1:18:08That's 100 times more efficient than GPUs.
- 1:18:10That's actually crazy.
- 1:18:11Yeah.
- 1:18:11No, that's actually crazy.
- 1:18:12It's a lot.
- 1:18:14Like, in terms of per watt, like, yeah.
- 1:18:17Having 100x decrease in watt, like, usage.
- 1:18:21That's not trivial.
- 1:18:22I mean, like, that's not so much.
- 1:18:25Yeah, yeah.
- 1:18:26That's so sick, actually.
- 1:18:28Yeah, yeah.
- 1:18:28And they proved it, you know, with their validation.
- 1:18:31Obviously, you make something like this.
- 1:18:33Okay, how are you validating that something like this works?
- 1:18:36So they got their digital twin to train on the MNIST data set, which is the classic handwritten digits data set to identify, like, two, three, four.
- 1:18:45Yes.
- 1:18:46Did really well on that.
- 1:18:48Train it on the MNIST fashion data set.
- 1:18:49Did really well on that.
- 1:18:51The other thing they did was they can really do.
- 1:18:53So this this was A.I.
- 1:18:55inference.
- 1:18:55The other thing they can really do is combinatorial optimization, which is this like this class of NP hard problems like the traveling salesman problem and things like that.
- 1:19:04that they can efficiently, they're not solving P equals NP, but they can efficiently solve NP hard problems using this technique.
- 1:19:13And one of the things that they were saying was, as I was reading, was like, you know, in MRI scans, the way the MRI scans work is like the patient has to go in and be there for like half hour to an hour.
- 1:19:24Because...
- 1:19:25What you got to do is you got to take a bunch of different little puzzle pieces of effectively what you're doing is you're taking like scans in frequency space because of the way that the physics of the MRI works.
- 1:19:40You're trying to look at the precession of hydrogen nuclei.
- 1:19:45the patient as you like disturb it.
- 1:19:47And then there's a magnetic field.
- 1:19:48So then the proton is going to relax.
- 1:19:51And as it relaxes, it releases light.
- 1:19:53And you were trying to gather this light.
- 1:19:55And that'll tell you some, it'll give you like a frequency map of the patient.
- 1:20:00And then from that frequency map, you go into like a positional map.
- 1:20:03Right.
- 1:20:04So in order to do that, it takes a lot of scans in this Fourier space to then reconstruct the actual thing.
- 1:20:10Right.
- 1:20:10Right.
- 1:20:11But there's a way to do it with something called sensing.
- 1:20:17Right.
- 1:20:17Like and what you can do is you can.
- 1:20:22very selectively probe this frequency space.
- 1:20:27And do it in a very smart way with this compressed sensing.
- 1:20:30It's like a zip file for sensing.
- 1:20:33And you can then reconstruct
- 1:20:37The image.
- 1:20:37Yes.
- 1:20:38Right?
- 1:20:38So they could do that.
- 1:20:40That's an optimization problem.
- 1:20:42Yeah, I get what you're saying.
- 1:20:42At the end of the day, right?
- 1:20:43I get what you're saying.
- 1:20:44And the compressed sensing is an optimization problem that they could then figure out.
- 1:20:48And they projected that, you know, instead of a 30-minute to an hour-long MRI, it'll take a patient five minutes.
- 1:20:55And then this thing can just, like, reconstruct it pretty quickly.
- 1:20:57What's an important point here is that the analog...
- 1:21:02infrastructure, the analog computer infrastructure that they've built, has this application as sort of a replacement for GPUs at inference time in the AI use case.
- 1:21:14Because it's good at one aspect, but it's also good at this combinatorial piece, which gives it implications in the medical field, for example, in decreasing MRI times.
- 1:21:24Because it's fundamentally so much faster and better at this very specific...
- 1:21:29function that is a part of the mri process that currently is using digital computers and if you just swap out the hardware infrastructure and a variety of other details to get it integrated into the mri workflow you're now just able to actually just do more with less yeah yeah and that's like super huge right yeah like now i can do like 12 patients instead of one right right that's
- 1:21:53I love.
- 1:21:54Yeah, so innovation is happening.
- 1:21:58For everyone who said innovation is dead, watch From First Principles because we will dispel that rumor quickly.
- 1:22:05We touched on four very, very fascinating stories this week.
- 1:22:09We started with 3i Atlas.
- 1:22:10Yep.
- 1:22:11We had some new imagery.
- 1:22:13It's not aliens.
- 1:22:14It's still very interesting.
- 1:22:16We may not live to 100, so Brian Johnson, watch out.
- 1:22:20But longevity studies are showing that there is a real plateau being reached in this sort of increase in life expectancy.
- 1:22:26There's huge implications for policy and economics related to how we shift the zeitgeist opinion about that to be connected to the fundamental frontier research in that area.
- 1:22:39We don't have to sort plastic anymore.
- 1:22:41We talked about this new nickel catalyst that enables this.
- 1:22:45That was a fascinating one.
- 1:22:46And last but not least, analog AI from Microsoft, which has potential to solve for the energy issue with AI.
- 1:22:55Yeah.
- 1:22:56But also has other applications.
- 1:22:58Yeah.
- 1:22:58We want to make AI better.
- 1:22:59Right.
- 1:23:00It's good.
- 1:23:01And cheaper.
- 1:23:02And cheaper, faster.
- 1:23:03Better for the environment.
- 1:23:04Yeah, who knows?
- 1:23:05Maybe it'll solve, like, the problems.
- 1:23:08Right.
- 1:23:09Right.
- 1:23:09If it also solves the NP problem, it might solve other problem types that we didn't have the tools for before.
- 1:23:14This is what we love to do here at From First Principles.
- 1:23:18Talk about this breaking science research.
- 1:23:20Break it down so you don't need a PhD to understand it.
- 1:23:23The implications here are crazy.
- 1:23:25My name is Lester Nare, joined, as always, by my co-host and our resident PhD, Krishna Chowdhury.
- 1:23:33all next week.