Latest / From First Principles / Can AI Help Wake Coma Patients? The Science of Consciousness (EP 35)
Transcript
- 0:00There's a question that haunts them every time, which is, is my loved one still there?
- 0:05And this question is one of the hardest problems in all of neuroscience, right?
- 0:10What is consciousness?
- 0:11He used AI to reverse engineer the biological mechanism of unconsciousness in coma patients.
- 0:19AI has rediscovered known features of unconsciousness.
- 0:22And then it's also predicted two entirely new biological mechanisms.
- 0:27Hello, Internet.
- 0:27This is your captain speaking, Lester Nare, joined as always by my co-host and our resident PhD, Krishna Chowdhury.
- 0:36We are back for another deep dive episode where we are going to talk about a paper today that's trying to tackle one of the hardest questions in neuroscience about comas.
- 0:48and how AI is helping us better understand the state of deep, prolonged unconsciousness.
- 0:54This was a paper published in Nature Neuroscience by friend of the pod, Daniel Toker, et al.
- 1:00on March 26th.
- 1:02And as always, we are going to learn about the science from the ground up, because this is From First Principles.
- 1:24Every year, tens of thousands of people fall into comas.
- 1:28And it's either from traumatic brain injury or a stroke, cardiac arrest, drug overdoses.
- 1:34And whenever this happens, some patients recover and some patients don't.
- 1:41We don't really know why some recover and why some don't.
- 1:44The other thing is for families that are sitting in that intensive care unit, there's a question that haunts them every time, which is, is my loved one still there?
- 1:53And this question is one of the hardest problems in all of neuroscience.
- 1:58What is consciousness?
- 1:59It's not just philosophically hard, which that's above my pay grade and we're not going to get into, but even mechanistically and clinically, this is a very hard problem.
- 2:08What is consciousness even physically speaking?
- 2:11Obviously, it has something to do with the brain.
- 2:15The human brain has 86 billion neurons.
- 2:19It's a muscle of fat and neural tissue.
- 2:23And it's quite incredible that that, like, sack of fat and tissue is where we get this profound phenomenon of consciousness, right?
- 2:32Our ability to perceive, to feel, to think, and to have this subjective experience of ourselves and the world around us.
- 2:41And it's all just from, like...
- 2:43this sack of like blood and fat in our skull, right?
- 2:48And one can ask, so it's somewhere in the brain, but what are the specific circuits that generate consciousness?
- 2:55And if a part of that circuit breaks, how does...
- 3:00it affect consciousness?
- 3:01And then can I actually figure out how to repair it, right?
- 3:05Now, doctors can observe that a patient is conscious or unconscious, right?
- 3:10Because they're not responsive, and they can classify the depth of unconsciousness on behavioral scales.
- 3:16But when
- 3:17All we can do really is like wait for them to wake up.
- 3:20There are some new therapies right now that we're going to get into that are maybe getting at trying to wake them up.
- 3:28But at the end of the day, we still don't have a way to peer inside the machinery of awareness and start asking like, what is the thing that is broken and how do we fix it?
- 3:38Okay.
- 3:38Or how do we replace it?
- 3:47and the actual mechanism that generates that it's kind of a little bit of a yeah dark cave yeah very much a black box in that sense right and that's why i really like this new paper it's a new study that i think represents a genuine step change in that field okay so it's a team that was led by daniel toker at ucla who is as you said a friend of the pod he went to college with us at princeton undergrad and
- 4:13Then I think he went to Berkeley for a PhD and then came to UCLA and now has like a gig with UCLA and USC as a postdoc.
- 4:22He's also the brain scientist on Instagram and TikTok.
- 4:26He's got a bunch of followers, really into science communication.
- 4:28You guys should check out his page.
- 4:30It's really, really cool.
- 4:32So...
- 4:34The cool thing about this paper, the cool thing that Daniel did was he used AI to reverse engineer the biological mechanism of unconsciousness in coma patients.
- 4:45And the way that he used AI is very different from, I think, when people think about using AI to do science.
- 4:53They think like, oh, black box LLM model.
- 4:55I like...
- 4:56Train it on a bunch of data and then it's going to spit out like a classifier consciousness or not consciousness.
- 5:02There's part of that here.
- 5:03But what really I think is cool about it is there's the AI has rediscovered known features of unconsciousness.
- 5:11And then it's also predicted to entirely new biological mechanisms.
- 5:16Mm hmm.
- 5:17Because the way that he has engineered this AI is it's not a black box.
- 5:22There's actual mechanistic understanding about a model of the human brain that he's hard-coded in.
- 5:29And that's what the AI is sort of acting on.
- 5:31That's what the evolution of the AI is acting on.
- 5:34And we're going to get into that.
- 5:35But I think it's very, very cool.
- 5:37And the implications are in every direction.
- 5:40I just want to make a quick note here.
- 5:43Yeah.
- 5:44We use the term AI in a very general sense when we discuss on the pod.
- 5:48It is a very expansive area of research with a lot of different subcategories and subboxes.
- 5:55So a lot of times we will just say AI for shorthand because we have a lot to get to.
- 6:00Yeah.
- 6:00But we don't mean AI equals LLM when we do so.
- 6:04Yes.
- 6:04It is sort of talking about the entire field of research.
- 6:07Yeah.
- 6:08at a high level and we then get into the weeds of what we're talking about specifically.
- 6:13But just as a small caveat note, that's important because it is a vast, vast space that is beyond just chatbots.
- 6:19Exactly.
- 6:20And this is very much not a chatbot.
- 6:22Right.
- 6:22It's very, very cool.
- 6:23We're going to get into it, right?
- 6:24And the implications, I think, radiate in all directions, right?
- 6:27Something like 5,500 Americans currently are in a persistent vegetative state and –
- 6:34There's a larger number that's in a minimally conscious state, and this research offers a genuine scientific pathway towards treatment.
- 6:41From the philosophy of mind perspective, it provides a very mechanistic specific picture of what makes a brain conscious.
- 6:50And then for an AI perspective, it's also very cool to think about how one can use brain.
- 6:56underlying principles of AI architectures to understand something as complicated as consciousness, right?
- 7:02So it's a deeply personal question that I think this is answering.
- 7:06Like consciousness is the one thing I think that we can all be sure exists because at least we experience it.
- 7:12It's the Descartes, I think, therefore I am,
- 7:15Clearly consciousness is a thing.
- 7:17Maybe the world isn't.
- 7:18Right.
- 7:18And quantum fields aren't.
- 7:20But consciousness, like 100 percent, like I am me, right, sitting here talking in this microphone.
- 7:26And you are you and everybody agrees that like that is a thing.
- 7:29So it's a deeply personal question.
- 7:33And it's still a phenomenon that we, I think, understand the least out of everything.
- 7:39So any question.
- 7:41Light that is shed on this mystery, I think, is certainly welcome.
- 7:45All right.
- 7:45So with that in mind, let's get into some of the history behind this type of research.
- 7:49Yeah.
- 7:50And we'll start all the way with the ancient Greeks.
- 7:53Always.
- 7:53OK, because the ancient Greeks, they had some crazy ideas.
- 7:57Like Aristotle thought that the brain was just a cooling organ for the blood.
- 8:03And consciousness actually lived in the heart.
- 8:05We're going to let that slide.
- 8:08Because other people like Hippocrates, the guy from the Hippocratic Oath, right?
- 8:13He noted that patients who fell into deep, unresponsive sleep after a head trauma rarely ever recovered.
- 8:20Okay?
- 8:21And the word coma comes from deep sleep.
- 8:26in Greek.
- 8:27So they had already sort of classified normal sleep versus this pathological deep sleep coma.
- 8:33They had already kind of figured that out.
- 8:35But again, it was just sort of an observation.
- 8:38Then in the Renaissance, there came the anatomical revolution with Visalius.
- 8:43He published this massive manuscript called De Humani Corporis Fabrica in 1543.
- 8:51He was basically really into dissecting human bodies.
- 8:56and gave us incredible drawings of human anatomy.
- 8:59So from there, now we've got an understanding of brain structure, right?
- 9:03But it's kind of like the machine is getting cataloged, but we don't really know what any of the parts are doing.
- 9:08So already by the early 1600s, we both had like a philosophical framework or concepts developing about classifying what these different parts of the body are doing and how that works.
- 9:19Like how that translates behaviorally.
- 9:21Yeah.
- 9:21As well as sort of a very detailed cataloging of the physical structures.
- 9:27Yeah.
- 9:27At least as it related to the brain and other key parts of the human body.
- 9:31You know, four or five hundred years ago.
- 9:33Yes.
- 9:33Yeah, exactly.
- 9:34It was a catalog.
- 9:35We didn't know what...
- 9:36Each thing did, but there was a pretty good catalog already, right?
- 9:40And then in the 1800s, we had some pretty revolutionary ideas.
- 9:45Paul Broca in 1861, he discovered this idea of cortical localization.
- 9:50There's an area of the brain now called Broca's area, and now we know that that damage to that area causes language loss.
- 9:58We also know that electrical stimulation in the motor cortex causes muscle movements.
- 10:06Thank you.
- 10:07a machine that has specialized parts, and each of these parts is doing something, right?
- 10:12The other invention in the 1800s was electrophysiology.
- 10:15In the 1870s, Richard Caton placed electrodes on exposed skulls of rabbits and found that there was electrical activity.
- 10:22And then we see Hans Berger in 1929.
- 10:25He develops the EEG, the electroencephalogram, which is you put leads on the skull and you can actually read electrical activity.
- 10:33And he found that the brain electrical activity
- 10:36dramatically changes with the state of consciousness.
- 10:40Okay?
- 10:41So different patterns mean waking, sleep, anesthesia.
- 10:46So already now it's like, okay, the brain is doing different things during unconsciousness, so perhaps the brain is really the seat of consciousness.
- 10:54That kind of makes sense.
- 10:55Yes.
- 10:55Yeah, yeah, yeah.
- 10:58Finally, 1949, Giuseppe Morozzi and Horace Maguan, they published this landmark paper...
- 11:04And this demonstrates something called the reticular activating system.
- 11:09It's a diffuse system that runs in the brainstem.
- 11:12The brainstem is where your brain meets the rest of the body with the spinal cord.
- 11:15So it's kind of like the connecting part of the brain.
- 11:19And they found that that part of the brain, the part that connects the brain to the spinal cord, that is essential for maintaining wakefulness.
- 11:28So now we've honed in on this is the sort of general area.
- 11:32where consciousness is probably happening.
- 11:35So to make a crude analogy, we figured out the brain is the factory, and we now know that different parts of the factory have different workers.
- 11:45The engineers are downstairs.
- 11:47The sort of manufacturing line is upstairs.
- 11:50The finance department is over here.
- 11:53But we didn't really know where the boss's office was.
- 11:56Yeah.
- 11:56Where's the boss's office?
- 11:57Yeah.
- 11:58Yeah.
- 11:58It seems like that's where it's the brainstem.
- 12:00Right.
- 12:00It's that part.
- 12:01Right.
- 12:02And over the following decades, we've mapped out that brainstem in more and more detail.
- 12:07So we figured out there's something called the locus coriolis.
- 12:10There's something called a basal forebrain.
- 12:13There's something that's part of the brainstem.
- 12:15There's the hypothalamus.
- 12:17There's the raphe nuclei.
- 12:18And so all of these like sort of parts, you see where the spinal cord is going in, that brainstem.
- 12:24junction is where all of this is happening which it's it's almost like even just from a crude structural like just looking at it you would imagine if the things that are most sensitive have the most protection just locationally yes locationally that makes sense from one perspective of evolution and the other perspective of evolution i think is that like the brain sort of grew out from that part right yeah
- 12:47So it's like the oldest part of the brain is the part that connects it to the rest of the body.
- 12:51Because, I mean, let's face it, like the brain evolved to control movement.
- 12:56Right.
- 12:56And so the brain controlling the rest of the spinal cord is sort of probably how it started.
- 13:01And then like higher and higher cognition formed around that.
- 13:03Right.
- 13:04Like, oh, OK, I need a sense of place.
- 13:06I need a sense of time.
- 13:09I need a sense of problem solving.
- 13:11All of that starts forming around this like nucleus.
- 13:14Right.
- 13:15And then the prefrontal cortex being the most advanced.
- 13:17The most advanced.
- 13:18That's the one that's like...
- 13:19Right in the front.
- 13:20Which, you know, it's very cool to think about it that way.
- 13:23Just like in terms of stages of development over the millions of years of evolution.
- 13:27Okay.
- 13:28Okay.
- 13:28So now we know that it's like kind of the brainstem, but we still don't have really an idea of like...
- 13:34Okay, this thing connects to this, this thing connects to this, so this is powering that, that, that, that, and so on and so forth.
- 13:402007, there's a pivotal moment in consciousness research because Nicholas Schiff and his colleagues published this paper in Nature.
- 13:48And it showed that continuous deep brain stimulation, this is the idea of we take an electrode...
- 13:53and we pulse it with electricity, that is going to excite the neurons near that electrode.
- 13:59It's just you're pumping electricity deep into the brain.
- 14:02That's why it's deep brain stimulation.
- 14:04And deep brain stimulation of the central thalamus helped a minimally conscious patient
- 14:10regain the ability to communicate and feed himself okay this was a very big deal because this was an ability that he had lost about six years earlier after a traumatic brain injury it's a preliminary result single patient notoriously in human consciousness studies and things like that the n is like very low single digits is you're already getting a lot because human i mean you're like experimenting on human beings right there's tons of ethical concerns yep there's not a lot of like
- 14:37You know, people who are willing to do this.
- 14:39And so even though the data is low, the fact that it worked means that there's something going on.
- 14:44So that sort of rejuvenated this research.
- 14:47And in 2010, that same author, Nicholas Schiff, he came up with something called the Mesocircuit Hypothesis.
- 14:54Okay?
- 14:55Effectively, what he's saying is the following.
- 14:57The consciousness relies on a network.
- 15:00of interactions between the cortex and the central thalamus.
- 15:04Okay.
- 15:04And that interaction is regulated by a part of the brain called the basal ganglia.
- 15:09We're going to focus on effectively three...
- 15:14regions of the brain.
- 15:15Okay.
- 15:16And I'm going to use an analogy of an electrical grid.
- 15:20Okay.
- 15:20Okay.
- 15:21A city's electrical grid.
- 15:22Yes.
- 15:22So the cerebral cortex, this is the part that's on the outside, the most sort of recently developed in humans.
- 15:29Um, this is the, when we think about the brain and all the wrinkles, that's the cerebral cortex that we're seeing on the outside.
- 15:35And that outer layer, it's responsible for higher thought, memory, sensory processing,
- 15:40And in this analogy of a city's electrical grid, this is your network of homes, podcast studios, businesses that consume the electricity, right?
- 15:50Now, the central thalamus is the deep brain relay station.
- 15:54That's the part that's sort of on the right over there in the pink.
- 15:58Just above the brainstem?
- 16:00Just above the brainstem.
- 16:01Okay, so that's getting input from the cortex, and it's also giving input to the cortex.
- 16:05Okay, so it's a two-way street.
- 16:07It's kind of like the primary power substation.
- 16:09Yes.
- 16:10It's pumping excitatory input to the cortex, but it's also getting excitatory input back from the cortex.
- 16:16So it's relaying a bunch of electricity.
- 16:18One way or the other.
- 16:19So one of the examples being if you have solar on your house, you're sending electricity back to the grid.
- 16:25It's not just you're receiving it as a practical example.
- 16:27That's very good.
- 16:28Yeah, yeah, yeah.
- 16:28No, that's exactly right.
- 16:30And this feedback loop kind of helps both run.
- 16:33Right.
- 16:34Okay?
- 16:34In some sense.
- 16:35And then finally there's the basal ganglia, and that's the striatum and the globus pallidus.
- 16:40Mm-hmm.
- 16:40That is a kind of regulatory system, and it's kind of like a voltage controller that manages the flow of power in this entire network.
- 16:49So in the summer when it gets hot, they have to decide where to send energy, where to not send energy in order to not overflow.
- 16:55Like there has to be – somebody decides, okay, we're going to shut down this neighborhood because we need to power the nuclear.
- 17:01Yeah, exactly.
- 17:03As a crude analogy, it's kind of routing signals, and it's controlling both the power stations and the homes to make sure there's balance and nothing's going out of the way.
- 17:13Okay, so that's how sort of the consciousness mechanism is working in healthy patients.
- 17:18What happens during a coma?
- 17:19Well, according to the mesocircuit hypothesis, here's what happens.
- 17:23When there's widespread brain injury, like from a traumatic brain injury or a stroke, so a bunch of neurons die because they don't get oxygen and things like that.
- 17:32your power lines are going to be down on the cortex, right?
- 17:34So you're going to get localized areas of power cuts, like we do in LA sometimes when somebody steals our copper from underground.
- 17:43But anyways, the cortex is now going to reduce its excitatory input to the thalamus.
- 17:49That connection is broken, as you can see, on the left.
- 17:51The thalamus and the cortex, that's now a dotted line.
- 17:54Instead of on the left, it's a solid line.
- 17:56Okay, the other thing is,
- 17:58There are these special neurons in the striatum called medium spiny neurons.
- 18:04And what they do, they're super prone to metabolic stress death.
- 18:09Meaning you, like, remove a little bit of oxygen and they'll just die.
- 18:13Okay?
- 18:13They're not very resilient.
- 18:14They're very finicky.
- 18:16And if those guys die, then the striatum is going to not inhibit the part that is inhibiting the thalamus.
- 18:24It's a double negative now.
- 18:25Okay.
- 18:25Okay?
- 18:26So...
- 18:28Because of that, so what it's doing is usually the striatum is like inhibiting the part that is putting brakes on the thalamus.
- 18:36Okay?
- 18:36But now that that brake is gone, the first brake is gone, right?
- 18:41Right.
- 18:42The second negative is going to go even more negative.
- 18:46Okay?
- 18:46And it's going to start inhibiting the thalamus even more.
- 18:48That's why that red line just got fatter.
- 18:50That makes sense.
- 18:51Right?
- 18:51So the thalamus is, one, not getting any input from the cortex because the power lines are down.
- 18:55Yes.
- 18:56And second, the part that was putting brakes on the thalamus has now gone hyperactive and putting even more brakes on the thalamus.
- 19:02So the thalamus is getting inhibited.
- 19:04It's getting shut down more and more in a coma because of these very tiny...
- 19:10Defects that have happened in exactly the wrong areas.
- 19:13Yeah.
- 19:14So this is very interesting.
- 19:15And what we're sort of saying here is the traumatic brain injuries are disrupting the normal flow between these three fundamental component parts.
- 19:26Yeah.
- 19:28The cortex, which is like the end destination, the Holmes example, the thalamus, which is sort of sending and receiving, and then the striatum and palliatum that are...
- 19:37kind of controlling the amount of what is or is not being sent and where it is or is not being sent.
- 19:42Exactly.
- 19:42And it's exactly at the right part where the thalamus, which is the relay station, is just getting signaled to shut down.
- 19:49Yeah, yeah, yeah.
- 19:50Okay?
- 19:50And when that shuts down, now this entire circuit of consciousness is getting shut down.
- 19:55It's almost like the fail-safe system that happens at a substation if there's some overload, just gets stuck in the locked position.
- 20:00Exactly.
- 20:00Exactly.
- 20:01Exactly.
- 20:02And there's some evidence that this mesocircuit hypothesis is probably correct.
- 20:07There's certain stimulant drugs, for example, amantadine, which enhances the inhibition to that break, like the part that's inhibiting the thalamus.
- 20:18amantadine inhibits that part.
- 20:20So it's no longer going to inhibit the thalamus kind of works.
- 20:24And it kind of wakes up patients from turning it to overclock.
- 20:26Yes, yes, exactly.
- 20:28So, so there, there's some mechanism that,
- 20:32where these drugs are kind of working with the mesocircuit hypothesis.
- 20:35But at the end of the day, still a hypothesis because it's not very granular, right?
- 20:39It's just like, oh, giant brain area.
- 20:43But the giant brain area has millions of neurons that are all different types.
- 20:47What type?
- 20:48What type is doing what, right?
- 20:50And also, you can't really test it directly because the bottleneck is standard animal models are really bad at mimicking neurons.
- 20:58human comas, this prolonged unconsciousness.
- 21:01And that just has to do with the fact that animal models like rodents, the brain is structurally a very different thing, right?
- 21:09Even though it's still a mammal...
- 21:11One of the things that we think happens during traumatic brain injury that causes this kind of coma is the idea of a diffuse axonal injury.
- 21:20Here's the idea.
- 21:20You've got the cerebral cortex on the outside.
- 21:23There's gray matter, which is like sort of the cell bodies.
- 21:26And then there's white matter.
- 21:27You might have heard of that gray matter and white matter.
- 21:29Gray matter is kind of like the cell bodies.
- 21:31The white matter is the axons.
- 21:32These are these like cables.
- 21:35Like, you know, the high voltage cables that come from, you know, Hoover Dam to L.A.?
- 21:39The axons are kind of like that.
- 21:40They're the high voltage cables.
- 21:42Now, if we go to a photo of the 14, what you'll see is the white matter is kind of in the middle and it's like connecting these areas of gray matter.
- 21:51But if you have a traumatic brain injury, let's say you got in a car crash or like, boom, like your brain had severe G-forces on it.
- 22:00Those axons, which are the cables, those are going to rupture first.
- 22:03Yeah.
- 22:04Right?
- 22:04Yeah.
- 22:05Now, with a small rodent, the brain is not big enough to feel that kind of G-force stress.
- 22:13Right?
- 22:13Ours is big enough.
- 22:14We're like, and we're like doing crazy things as humans.
- 22:17We're like, we're driving around at 70 miles an hour.
- 22:20We're like, we're now subject to G-forces if something goes wrong.
- 22:24Right?
- 22:24And so our brain is just not evolved.
- 22:28When we were hunter-gatherers in Africa, like evolving, the evolution didn't think, hey, I should probably make this brain, you know, withstand getting hit by another 350-pound man in an NFL game.
- 22:41Yeah, exactly.
- 22:42Exactly.
- 22:44So there's a mismatch between what the brain has designed, the environment that the brain is designed in, and then what the brain was capable of creating, which is like human beings in cars and all this other crazy stuff, skiing and then hitting a tree and things like that.
- 23:00Right.
- 23:01Right.
- 23:01So – and we simply can't test –
- 23:05In rodent models.
- 23:06Right.
- 23:07Okay.
- 23:07And this is something we talked about in a recent previous episode too about just, you know, there are a lot of opportunities to use animal models, which the purpose of which, yes, for folks who are, you know, PETA adjacent, et cetera.
- 23:22The ethical concerns about testing directly on humans are so prevalent that it's perceived as a lower ethically bad option.
- 23:32100%.
- 23:33And for an outcome that's going to save millions of lives at some point in the future.
- 23:36Yeah.
- 23:37Yeah, but here, like...
- 23:38It doesn't.
- 23:39It doesn't.
- 23:39The ethics, like, is even more problematic because, well, you're not going to get anything out of it.
- 23:44Right, right.
- 23:45Right.
- 23:45And so you're just... Yeah, you're just, like, wasting animals at that point, right?
- 23:50Right.
- 23:50And that's not something that we want to do in science research.
- 23:53Right.
- 23:53So that's one bottleneck.
- 23:55Okay.
- 23:55Okay.
- 23:55which is just animal models are not a thing.
- 23:58The second bottleneck is the diagnostic crisis.
- 24:01Okay.
- 24:01This is in general with consciousness in medicine.
- 24:05Okay.
- 24:05Consciousness has two fundamental components.
- 24:07There's wakefulness, which is like arousal, like when you're awake.
- 24:10And then there's also awareness.
- 24:11That's the qualitative experience of like me being me and seeing you and everyone else.
- 24:17Right.
- 24:17This is some qualitative subjective experience that only I have about what it's like to be me.
- 24:22Right.
- 24:23So,
- 24:24disorders of consciousness that comes from physical trauma and oxygen deprivation, there's several different types.
- 24:29So in a coma, you have neither arousal nor awareness, right?
- 24:33Because you can't be awoken.
- 24:35Yes.
- 24:35There's no sleep-wake cycle.
- 24:37Yes.
- 24:38And they fail to respond to stimuli.
- 24:40The lights are off.
- 24:41Yeah, lights are off and maybe nobody's home.
- 24:43Right.
- 24:43Okay?
- 24:44Vegetative state means it's also called unresponsive wakefulness syndrome.
- 24:49Okay.
- 24:49You have wakefulness.
- 24:52And you have a sleep-wake cycle, but perhaps you have no awareness.
- 24:55So the lights are on, but maybe nobody's home.
- 24:58Okay.
- 24:59But now it gets kind of weird.
- 25:01Like, what if they are aware, but they just can't...
- 25:06have any agency over their motor controls right so how can you tell so someone's home but they can't answer the door when you ring the doorbell exactly yeah lights are on lights are on and someone is home yeah you ring the doorbell but they can't yeah that's very good yeah exactly how do you how can you tell right this is a yeah that's subtle that's very subtle and for the
- 25:30Science paper 2006 by Adrian Owen.
- 25:33It's a landmark paper.
- 25:34It's quite incredible.
- 25:35This was a wake-up call, so to speak.
- 25:38Okay.
- 25:39He used functional MRI to ask a patient that was diagnosed in a vegetative state to imagine playing tennis and imagine walking around her home.
- 25:50And the brain activity from that fMRI study was identical to someone who was fully aware.
- 25:57So she's there in this vegetative state.
- 26:01There's no way that she can express her awareness.
- 26:04Mm-hmm.
- 26:05But if we look into the brain MRI, it's the same as someone who's aware.
- 26:10The idea being they may not be able to move their hands to touch a button or verbalize.
- 26:17Or even move their eyes.
- 26:18Or move their eyes, which is techniques that have been used before to communicate.
- 26:23Now we're just saying it's because the awareness is in the brain.
- 26:27And so you shouldn't actually need any of these secondary things.
- 26:30uh meth avenues yes to communicate and the only way to make the differentiation between the uh is someone home versus someone not home reference point you have to go directly to the source yeah if all of their physical capacities yeah are are not available to them which does not necessarily mean yeah that no one is home
- 26:51Exactly.
- 26:52It's like no one's answering the door, but here it's kind of like we did an X-ray of the home.
- 26:55Yeah, yeah.
- 26:55And the person is moving around.
- 26:57Right, right.
- 26:57We have the thermal and you can see.
- 26:58Yeah, exactly.
- 26:59You know?
- 26:59Okay.
- 27:00I thought that was a very cool paper.
- 27:01That is very clever.
- 27:02It's very clever.
- 27:03And now it's a real crisis, right?
- 27:07Right.
- 27:07Because now there's a third.
- 27:08It's called minimally conscious state.
- 27:10Mm-hmm.
- 27:10Okay?
- 27:10And it turns out that 15% to 20% of patients that are classified as vegetative... Mm-hmm.
- 27:17actually might have covert conscious awareness.
- 27:20That's a lot.
- 27:21That's got to be terrifying.
- 27:22And that's got to be so terrifying.
- 27:24Right?
- 27:24Because you can hear and see everything happening around you, and you cannot engage in that environment.
- 27:28That's just unbelievable.
- 27:29And this was only 20 years ago, 2006, right?
- 27:32After this 500-year cycle we've just talked about.
- 27:34Yeah.
- 27:34So, I mean, this field is just one of those where you can really sit back and be like, wow, we really don't know much about the brain.
- 27:42Right.
- 27:42Right.
- 27:43Right, right.
- 27:44Because this is like kind of, you know, people's, this goes to the materialist, non-materialist debate.
- 27:51You know, is it that consciousness arises out of matter or is consciousness primary, which gets a little, that's, again, that was above our pay grade and not the focus of this podcast.
- 28:03Yeah.
- 28:03But it is one of those.
- 28:05It's the first question.
- 28:07Yes.
- 28:07Because once you get, you know what I mean?
- 28:10You can't, everything else downstream is really impacted by which of the two.
- 28:14Which of those two, right?
- 28:15What are we talking about?
- 28:16Right.
- 28:17Who am I?
- 28:18Who are you?
- 28:19And what the hell is going on?
- 28:21Right.
- 28:22That's how I like to say it.
- 28:23Right.
- 28:24Right.
- 28:25You know?
- 28:25And so with these kinds of studies, it's really like underscoring how much we don't know about this, right?
- 28:33Right.
- 28:34And now 15% to 20% of patients, we're saying, are classified incorrectly.
- 28:39Which is fascinating.
- 28:40Because, I mean, I'm sure after that study, a variety of... Because the fMRIs are not hugely...
- 28:47negative for a patient no so at least as a way especially for families or anybody to try um but in any event exactly so now we finally get to um daniel's paper daniel toker in nature neuroscience adversarial ai reveals mechanisms and treatments for disorders of consciousness it's a really innovative way of using machine learning and the vast amount of data that's now available
- 29:12On comatose patients, vegetative patients.
- 29:16He's made an in-silico model of coma.
- 29:19So a computer model of the brain that circumvents the lack of mouse models.
- 29:26So now I have a model in the brain that I can play with.
- 29:30A model of the brain in my computer that I'm fairly confident is quite good.
- 29:34That I can play around with.
- 29:35Because the idea is it's based off of this real-world data.
- 29:38Anonymized.
- 29:38Yeah.
- 29:39Yeah.
- 29:41data.
- 29:42Exactly.
- 29:42And then I can figure out a kind of mechanistic model about how consciousness works, what gets disrupted to make a coma, and then it becomes a kind of discovery engine.
- 29:52From that, we can mess around with it and propose new treatments.
- 29:55And he is doing all of these.
- 29:57Very well done, Daniel, by the way.
- 29:59Quite good.
- 30:00Quite good.
- 30:01Again, thebrainscientist on Instagram.
- 30:04And before we deep dive into it, let's do a little bit of housekeeping.
- 30:08Yes.
- 30:09So as always, we are so grateful for all of you to join us for these research deep dives.
- 30:15It's just an incredible, not only an incredible time to be alive, but...
- 30:19But the opportunity to really understand not only what we're learning today, but how it works and what the history of how we got here, you're not going to get it anywhere else.
- 30:29And this is why we love doing this show at From First Principles.
- 30:33And it is hugely helpful to us to continue to bring you the best and greatest breaking science research.
- 30:40As we, as I always say, fight the billionaire algorithms, a like, a share, a comment, a DM, sending it to a friend, bringing it into Journal Club is hugely, hugely helpful for us where it's, again, still just the two of us running the show to be able to give this to you multiple times every week.
- 30:57If you would like to become a patron, you can donate to the pod at ffppod.com backslash donate.
- 31:04Any and all support monetarily or non-monetarily is hugely, hugely valuable, and we really greatly appreciate it.
- 31:12I have no other show notes this week, and I'm very excited to dive back into this paper.
- 31:17Let's do it.
- 31:17Okay.
- 31:18So first thing I want to do, right?
- 31:21I want to use artificial intelligence to make a discovery engine for my brain, figure out why comas happen, and then propose treatment.
- 31:29That's the end goal of this paper, okay?
- 31:31Okay.
- 31:31First thing I want to do is train an AI detective that is capable of diagnosing consciousness from raw brainwaves.
- 31:38Okay.
- 31:38Okay?
- 31:39Just can I identify consciousness if you give me the, you know, sort of brain activity, the electrical activity of a brain?
- 31:48So he made something called a deep convolutional neural network.
- 31:51These are just our normal, you know, CNNs that we hear about.
- 31:55Giant network of artificial neurons that is trained through backpropagation.
- 32:00You know, supervised learning, which is just we've got about 680,000 10-second neurons.
- 32:07electrophysiological recordings.
- 32:09So 680,000 recordings of brains, electrical activity.
- 32:14These recordings come from humans, monkeys, rats, and bats under anesthesia, in a coma, and wakeful.
- 32:20So a swath all across mammals.
- 32:24So that means it's not going to really hone in on some human feature.
- 32:27It's going to really start thinking about what is the nature of consciousness itself.
- 32:32Right?
- 32:33And he made three discriminators.
- 32:37neural network that was going to get trained on the cortical data.
- 32:40There's a thalamic and then there's a palladial.
- 32:43That's the three sort of big brain regions that we were talking about in that mesocircuit model, right?
- 32:49The core, the cortex is your grid with all the homes and the podcast studios.
- 32:56The thalamus is the relay station and the palladial station is kind of like governing what's going on between these two.
- 33:05Right?
- 33:05Yes.
- 33:05Okay.
- 33:06Okay.
- 33:08Once he trains it, he validates it.
- 33:10It's pretty good.
- 33:11The AI score for consciousness, which is plotted on the y-axis, is...
- 33:17is correlated with the ground truth score of consciousness that it was given to each sample in the test sample.
- 33:24Okay?
- 33:24Which means that, like, the AI, this deep convolutional neural network, is given a sample that it's never seen before, and it's told to guess how conscious it is based on a number between 0 and 1.
- 33:36That number is correlated with the ground truth.
- 33:38Okay, so that means it's working.
- 33:39Yes.
- 33:40The other big one that I quite liked is from figure 1J, if you see over there.
- 33:44What that shows is that the AI was able to classify fully paralyzed ALS patients as conscious.
- 33:53Remember in ALS, we did the story where it's a motor neuron disease, right?
- 33:57All of your motor neurons go away.
- 33:59So you can still be conscious, but you won't be able to...
- 34:03fully express that.
- 34:05Here, they looked at EFIS recordings from ALS patients, and there's no significant difference between them and healthy cortical activity.
- 34:15This is actually a fascinating follow-up to our ALS story because we did a great deep dive on understanding what it actually is mechanistically.
- 34:22Yes.
- 34:23Yes.
- 34:24And it dovetails with what we said earlier, which is just because your motor functions go away.
- 34:29ALS is a perfect example of what we were just talking about.
- 34:32It doesn't necessarily mean that there's no one home.
- 34:35Yeah, yeah.
- 34:36That's very – Exactly.
- 34:37And this was able to find that, right?
- 34:38Without motor output, you can now classify.
- 34:41That's it.
- 34:42So already big win.
- 34:43Figure one.
- 34:43Yes.
- 34:43Yes, that is huge.
- 34:45Right?
- 34:45That's good.
- 34:45That is huge.
- 34:46Okay.
- 34:47Now next, we've made a detector.
- 34:49We've made a detector of consciousness.
- 34:51Yes.
- 34:51Now that we have a consciousness detector, let's make a brain simulator that can make my own brain signals.
- 34:58Okay.
- 34:59Okay?
- 34:59And this is where we get into the real why there's AI in the title.
- 35:04Okay?
- 35:04Okay?
- 35:05Because just making a deep convolutional neural network that will classify, that's just an autonomous classifier.
- 35:11Right, right.
- 35:12That's like 10 years old.
- 35:13What are you doing?
- 35:13Right?
- 35:14You're not going to get into nature neuroscience like that.
- 35:16And Daniel knows that.
- 35:18And this is for the social clips.
- 35:19If we end up clipping the first half without the second half...
- 35:23Please watch the pod so you get the full story.
- 35:25Yeah, so they're not like, that's not what I mean.
- 35:27I can't believe that's a nation you're not saying.
- 35:29Yes, we know.
- 35:30We can't fit an hour-long thing onto Instagram.
- 35:33Yeah.
- 35:34Okay, so now what he's going to do is make a brain simulator.
- 35:37Mm-hmm.
- 35:38He's going to combine that discriminator that he got, the AI, the consciousness detector, with something called a generative adversarial network.
- 35:46These are GANs.
- 35:47Traditionally with GANs, I mean, they're kind of used to make, like, generative AI, like, photographs and things like that.
- 35:53Here's how it works.
- 35:54So this is very different from, like, a diffusion model, which is usually kind of used in the zeitgeist.
- 35:58GANs kind of didn't have popularity.
- 36:00They had popularity for a while.
- 36:02And then diffusion kind of went up and became the generative network.
- 36:06sort of paradigm.
- 36:07But then now GANs are kind of back up.
- 36:10We don't really know which architecture is going to win in the end.
- 36:12But here's the idea.
- 36:13Okay?
- 36:14So you've got something called a forger, which is trying to forge...
- 36:21real life data.
- 36:22For example, in this case, what we're trying to do is create real faces.
- 36:26So we're going to have a data set of real faces, and then we're going to have a forger, that's the generator over there, and that's going to generate faces.
- 36:34And then we're going to have a discriminator,
- 36:37On the other side, that is going to take the real data and going to take the forged data and try to figure out which one is forged and which one is real.
- 36:44Now, in the beginning, it's going to be obvious.
- 36:46In the Beninging.
- 36:47Yeah.
- 36:47In the beginning, because the forger doesn't have any training.
- 36:50He's just going to be making up random nonsense.
- 36:52Right.
- 36:52So the discriminator is going to be able to look and be like, oh, yeah, this is real.
- 36:55This is fake.
- 36:56But as the forger gets better and better, because...
- 36:59That output of, hey, this is fake, you keep making fake stuff, I want the real stuff, that output is getting back propagated through to the forger.
- 37:07And the forger is thinking, okay, how do I get better?
- 37:09How do I get better?
- 37:10Pretty soon after multiple rounds of training, the forger is going to get good at making the real data such that it fools...
- 37:19You're a discriminator.
- 37:20Yes.
- 37:20Okay?
- 37:21That's the generative part, and the adversarial part is you've got two networks that are adversaries.
- 37:26There's a detective that's trying to detect the fakes, and then there's a forger that's trying to create even better fakes.
- 37:32That's the adversarial part, right?
- 37:34For anyone who's ever used image generation, particularly mid-journey, this structure is exactly the reason why you'll see a blurry, weird thing happening.
- 37:44when you first initiate the image generation, and then it's going through the cycle, you just talked about it, the fidelity gets closer and closer and closer over until it gives you the final, like produced like image.
- 37:56This is like the whole stable diffusion kind of came
- 37:59Yeah, and that one's slightly different.
- 38:02Slightly different because – so what you're talking about is very, very close to generative adversarial networks because at the end of the day, how the forger creates the fake stuff is it starts with some kind of random noise, which is what you see there.
- 38:13And then it starts manipulating that noise to create the real thing.
- 38:18So what you're seeing there is the act of the forger, in some sense, going from noise to the real thing.
- 38:25But the training part is something that's already been done by mid-journey on the backend.
- 38:29100%.
- 38:29And so that's the generative part.
- 38:34Yes.
- 38:34Okay, great.
- 38:35So now...
- 38:37Great.
- 38:38That's how you make a fake Picasso and a real Picasso and things like that.
- 38:41How are we going to use that to figure out coma?
- 38:43Yes.
- 38:44All right.
- 38:45This is where Dan comes in hot with an interpretable biophysically grounded mean field model.
- 38:54Okay.
- 38:54And that is what is cool.
- 38:55So on the upper left, that's A, figure A.
- 38:58Yes.
- 38:58Okay.
- 38:58On the left-hand side, we've got our DCNN, the convolutional neural network.
- 39:02That's our detector.
- 39:04that we had trained previously in figure one, right?
- 39:06There's other detectors in here that'll actually figure out, is this real or fake data?
- 39:12That one is saying, is this unconscious or conscious data?
- 39:15There's other ones that are not in this backend.
- 39:17You have to go to the supplement to see it, where it's like, is this real data or fake data?
- 39:21Because first we want to just create...
- 39:23Real looking data.
- 39:24Then we'll worry about, okay, am I creating conscious data or unconscious data, right?
- 39:28So there's multiple steps to this process.
- 39:30But the key is that the forger is not a black box, okay?
- 39:35The forger is actually a three component within which there's multiple components.
- 39:41Yes.
- 39:42But you know that mesocircuit hypothesis of like there's a cortex, there's the basal ganglia, there's the thalamus, and these guys are talking to one another?
- 39:49Each of those boxes is its own little neural network, right?
- 39:53And it's a biophysically realistic neural network in the sense that it's not just a bunch of artificial neurons that start at noise.
- 40:01What it's doing is...
- 40:03It's saying, okay, how does a biophysical neural network work?
- 40:06Well, some input comes in, then there's going to be like channels, like, you know, some neurotransmitter is going to have some characteristic timescale.
- 40:15Other neurotransmitters are going to have other characteristic timescales.
- 40:18There's going to be excitatory neurons, which do positive feedback.
- 40:22There's going to be negative inhibitory neurons that do negative feedback.
- 40:26These I can hook up mathematically using differential equations, and I can create a biophysically realistic model.
- 40:34It is no longer a black box.
- 40:36And instead of using backpropagation to change the weights between each neuron, what I'm going to do is use something called a genetic algorithm to...
- 40:46to change the parameters of my biophysically realistic model, meaning how many excitatory neurons are there?
- 40:53How many inhibitory neurons are there?
- 40:55How is the connectivity, right?
- 40:57What is the timescale?
- 40:59of the interaction things like that things that are actually relevant when we think about what is a brain doing and is in some sense the reason why it made it's like the that algorithm is necessarily bounded by what the realistic value ranges are exactly and that's why it's not a black box because you know that oh it's either going to be excitatory neurons are either going to go between x and y yeah and that's a realistic normalized range
- 41:25Exactly.
- 41:26That's one of them.
- 41:27And the other one is we can literally point to components of the model and be like, oh, it's the excitation and the thalamus.
- 41:32Ah, yeah, yeah.
- 41:33That's right.
- 41:35I can literally be like, oh, it's this part.
- 41:37Yeah.
- 41:37With again, it's like with normal neural networks, I don't have no idea.
- 41:41Yeah.
- 41:42Like, you know, I type in make me a cat on a horse.
- 41:46I have no idea in the trillions of parameters where it decided.
- 41:51cat, where it decided horse, how it figured out to put the cat on top of the horse.
- 41:56Here, literally, I could look into the parameters.
- 41:59I can see how they evolve with training and figure out what is actually going on.
- 42:03And then make that extrapolation from there to the brain.
- 42:07That's very good, I think.
- 42:08That's very good.
- 42:09Right?
- 42:09Yeah.
- 42:10And that's one of the things I like a lot.
- 42:12Yeah.
- 42:12Right?
- 42:13This loss function, he had a loss function that sort of, like, figures out, right, how to change the parameters.
- 42:19And this loss function incorporates the outputs from the networks that's trained to classify real versus synthetic data.
- 42:26It also has outputs from the consciousness detector that we had done earlier.
- 42:30It's also got a way to identify seizures.
- 42:32Yeah.
- 42:33And as you said, it's got these empirical constraints on the firing rates of these neurons, as you said, like, right?
- 42:39Excitation can't be that high.
- 42:41Inhibitory neurons are usually higher firing rate than excitation.
- 42:44Things like that, right?
- 42:45And the interregional communication patterns.
- 42:47Right.
- 42:48Like excitation is long range.
- 42:50Inhibition is usually short range.
- 42:52This is stuff you can bake into the model.
- 42:54This is quite nice.
- 42:55This is quite nice I love the fact that it's not black box Because that's one of the things that I hate about Like just large neural networks I have no idea where anything is happening And it's also so different from the culture of software Since its beginning Which has been that everything is explicit And you can literally point to Where exactly, like the trace callback Of where something is coming from This is the going back to that type Which is great This is like, yeah, fantastic Fantastic
- 43:23And so once this genetic algorithm has trained my brain maker, it's an artificial brain, now we can ask, okay, how about we reprogram the objective now?
- 43:35Okay.
- 43:35It was just making real world data.
- 43:37Now I reprogram the objective to make comatose data.
- 43:41So I can use that first neural network to be like, give me coma.
- 43:45Right.
- 43:46Right.
- 43:46Yes.
- 43:47Right.
- 43:47And then now that genetic algorithm is going to tweak the parameters such that I get coma type data.
- 43:52Yes.
- 43:53And just I just want to bring this back in because we have done the training and done the validation based off of a ground truth, real source of actual information.
- 44:03Yeah.
- 44:03We have all of those 10 second long clips.
- 44:05Right.
- 44:06That's like I just it's not making this from whole cloth.
- 44:11No.
- 44:12That's a really important concept.
- 44:13Yeah, and there's multiple stages of training.
- 44:16Right.
- 44:16He's figured out a way to, you know, you can't just tell a biophysical model, make me coma.
- 44:22Right.
- 44:22Right.
- 44:23You got to first be like, no, no, no, let's make just normal data.
- 44:27Give me data that can fool even me to thinking, I don't know if that's from a real patient or from my brain simulation.
- 44:34Right?
- 44:34Right.
- 44:35I'm sure he did like checks just on his own.
- 44:37Yes.
- 44:37Where like after the whole thing, I mean, you look at it, it's like, okay, that looks pretty good.
- 44:40Yes.
- 44:40Right.
- 44:40And then you go, okay, now give me a coma.
- 44:43And he was successfully able to recreate known phenotypes.
- 44:46Like on the right-hand side, we've got high voltage delta oscillations.
- 44:49This is something that happens in coma.
- 44:50Like the slow sort of oscillations that are super high voltage.
- 44:54We've got burst suppression that's on the bottom side.
- 44:56Yeah.
- 44:57Big bursts and then just seconds of inactivity.
- 45:00Again, something that's there in coma patients.
- 45:03What's cool is,
- 45:04There's no explicit programming of prior neuroanatomical knowledge on what is the difference between a coma versus a normal brain.
- 45:15Okay?
- 45:16Just the genetic algorithm and that detector that I had of coma versus conscious.
- 45:22Yes.
- 45:23Just that and the genetic algorithm has now independently discovered some of the core tenets of that mesocircuit hypothesis, right?
- 45:32What did the mesocircuit hypothesis said?
- 45:34It said that if I weaken cortical drive coming in from the cortex, that's going to cause a bunch of random crap.
- 45:41That's what my model is doing.
- 45:45So as a first pass, it's already kind of on the right track.
- 45:48You can smell...
- 45:50it in the water like there's i'm on the right track because right the normal stuff that i kind of know about the mesocircuit that i hadn't baked in explicitly it's already figuring that out it is in it it is being it is able to intuit uh what we've already done over this last five six hundred years that we talked about um out of the box without this is sort of what people say about benchmarks and ai models it's like
- 46:16well, if you train it on the benchmarks, then it's going to do good on the benchmarks.
- 46:19And so the point here, it's not, the answers to the test were not provided as a part of training.
- 46:26And so it's getting answers that are not tainted by sort of giving them the cheat sheet beforehand.
- 46:33Yeah, yeah.
- 46:33Yeah, it's just looking at how do I make a coma and already it's recreating parts of the mesocircuit hypothesis that we know are probably true.
- 46:41Right.
- 46:42Okay.
- 46:42Right.
- 46:42So that's already impressive.
- 46:44The next part is the impressive part, which is what is the new stuff?
- 46:48I just want to say this is all already very impressive.
- 46:50And just as another caveat, we're talking about Daniel specifically.
- 46:53This was obviously a team and this is incredible work by everybody on the team.
- 46:56yeah yeah yeah everybody is our friend so that's why we're talking about daniel yeah all right all right so but clearly yeah this is this is very i mean there takes a lot of data it takes a lot of like it takes a lot of brain it's always a team effort guys every time we're talking that's always a team yeah yeah so let's get back to daniel yeah okay um here's here's what he's gonna do next okay okay so
- 47:22The one part of the mesocircuit hypothesis, which is like cortical drive goes down, so the normal power grid is down, or there's elevated firing in the palladial population, so that's going to inhibit the thalamus even more and things like that.
- 47:38That stuff is already corroborated.
- 47:40Stuff we already knew, this thing is kind of confirming.
- 47:42Okay.
- 47:43Now—
- 47:44Does it do anything new?
- 47:45Well, yes.
- 47:46There's something called the selective disruption of the indirect pathway.
- 47:50This is a new prediction from the model.
- 47:54Here's what's happening.
- 47:55So it turns out the prediction is that the coma is actually driven by the degradation of the...
- 48:04Certain medium spiny neurons.
- 48:06Remember those neurons that I was telling you about?
- 48:08They just die if there's any stress whatsoever.
- 48:10Or a little bit of loxia deprivation immediately.
- 48:14They're just like, okay, I'm done.
- 48:17There's selective degradation of a certain type of medium spiny neuron in the striatum that is projecting to the part that's putting on brakes to the thalamus.
- 48:28And this very specific pathway is
- 48:33is new.
- 48:34Okay?
- 48:34The classical mesocircuit hypothesis is just like, oh, there's like striatal dysfunction.
- 48:40Right?
- 48:40It's like the whole brain region.
- 48:42Yeah, yeah.
- 48:42Right?
- 48:43This thing is saying that the indirect pathway, which is specifically this D2 receptor expressing medium spiny neuron, this very specific subpopulation in the striatum, that's the part
- 48:56That is getting weakened.
- 48:57And when that gets weakened, that's going to ultimately suppress the thalamus at the end of the day.
- 49:02Like that thing that I was telling you about.
- 49:04But now it's identified a little part.
- 49:06It's not just all of L.A. County.
- 49:08We've got it down to a street block.
- 49:10Yeah, and a specific type of house type thing.
- 49:12Right.
- 49:12Right?
- 49:13Okay, so how do you... Fine, that's your prediction.
- 49:16Predictions are only as good as the data that...
- 49:19Corroborate.
- 49:20Right.
- 49:20So how do we corroborate it?
- 49:21We use something called diffusion tensor imaging.
- 49:24So this is an advanced form of, like, MRI.
- 49:26Oh, this is beautiful.
- 49:28What we can look at is trace.
- 49:30This is very cool.
- 49:30What you can do with MRI is magnetic resonance imaging, right, where you look at, like, hydrogen atoms in whatever biological tissue, and you can actually...
- 49:43See that using this magnetic resonance imaging technique.
- 49:45I'm not going to get into how MRI works, but effectively we can trace hydrogen atoms.
- 49:50Okay.
- 49:51Water has a bunch of hydrogen atoms.
- 49:53Okay.
- 49:53So we can measure the directional diffusion rate of water molecules along the axons, along those fibers.
- 50:01Mm-hmm.
- 50:02Those neurons right and we can measure in white matter the water is going to move faster along the length of the axon Then across and so we have a directional idea of like how Diffusion of water is going and diffusion of water is a proxy for kind of how neurons talk to one another Where is it?
- 50:19How's the traffic and flowing right?
- 50:20Yeah, exactly.
- 50:22So what they did was
- 50:23was use this DTI, diffusion tensor imaging, of 51 patients with disorders of consciousness.
- 50:30And you can show that there's significantly lower striatum to GPE streamlines.
- 50:37That's the break on the thalamus.
- 50:39That prediction is lower in vegetative state versus minimal consciousness patients.
- 50:45No way!
- 50:47Yeah.
- 50:47So just to take a step back, right?
- 50:50From this model...
- 50:52it made a prediction about where specifically in this region of the brain that is controlling the flow between the thalamus and the cortex is the point where the degradation of this specific area is what's actually driving the problem.
- 51:07And this connection is where we would find it.
- 51:11And so it said this is the road and the house where the problems are.
- 51:16Arise out of.
- 51:17And then we said, okay, well, we have all this actual MRI data from real patients.
- 51:23So can we look at this road, this house and real patients that the model predicted you would see degradation in an outsized way as compared to surrounding area?
- 51:35Yeah.
- 51:36I mean, no, they compared vegetative versus minimally cognitive.
- 51:39Right, right.
- 51:40Because we've got those two sets.
- 51:41Yes.
- 51:41And if there's a difference, there should be some statistically...
- 51:44Some delta between those two.
- 51:46The vegetative will have more of the degradation than the minimally... Oh, my God.
- 51:51Yeah, yeah.
- 51:52And so on the left-hand side, we see that significance.
- 51:57There is a significant difference.
- 51:58On the right-hand side, he did sneak the sin.
- 52:00The p-value is only 0.07.
- 52:01So it's not significant.
- 52:04Yeah.
- 52:05But it's there.
- 52:06And perhaps if you were to pull the two data, it would become even more significant.
- 52:09But there's at least something.
- 52:13And the N is low.
- 52:15So obviously significance is not... We're not going to get Higgs boson 10 to the minus 5 significance here.
- 52:21Where literally to do that, they had billions of...
- 52:26particles colliding with each other, right?
- 52:28So you'll never get the significance level of traditional physics, but the effect, it seems, is there, right?
- 52:36And with more and more data, perhaps it's going to be an even bigger effect.
- 52:39Makes total sense.
- 52:40It was really kind of a proof of, like, minimally viable proof that this hypothesis of this little...
- 52:49Prediction that I have, it's probably true.
- 52:51It was good enough for nature neuroscience.
- 52:53Yes.
- 52:53Not bad.
- 52:54Exactly.
- 52:55The second thing that they did was predict, this whole AI architecture predicted, that there's increased synaptic coupling between inhibitory interneurons, meaning those negative feedback neurons that I was telling you about, these are sometimes called fast spiking PV plus neurons in the cerebral cortex.
- 53:13Those negative feedback neurons in our cerebral cortex have a lot of...
- 53:18Coupling in between them.
- 53:20So it's like the negative feedback is coupled to the negative feedback, which is coupled to the negative feedback.
- 53:24Right?
- 53:24That is what the AI model is predicting.
- 53:28So to test this, you go to transcriptomics.
- 53:32Transcriptomics means I'm going to now read...
- 53:35the mRNA that is in my cerebral cortex, okay?
- 53:39And I'm going to see what genes are being expressed in patients that have vegetative state and patients that don't.
- 53:47Okay, healthy versus those in coma.
- 53:49Yes.
- 53:50What they find is there's an upregulation of two genes, the VGF and the SCG2.
- 53:57These are genes that, when expressed in these interneurons,
- 54:02They drive synaptogenesis, meaning they drive this feedback mechanism, this coupling.
- 54:08Yeah, yeah.
- 54:09That.
- 54:09Right?
- 54:10This is really...
- 54:11This one's pretty significant.
- 54:12Yeah.
- 54:13This one's way more than...
- 54:15In both those genes.
- 54:16Yeah, yeah, yeah.
- 54:16Right?
- 54:17And this is, again, data that's out there.
- 54:20Right, right, right.
- 54:21Right?
- 54:22Exactly.
- 54:22And I think the...
- 54:24This is kind of, again, in terms of like a frame of reference for...
- 54:28I've seen the conversation around quote-unquote AI be very different within some corners of the science community versus the general public because a lot of researchers view it in this way where it's like, okay, this can be a sort of intermediary layer.
- 54:44where I can rapidly prototype and generate predictions and rapidly be able to test that against real data in a way where I don't have to abuse my postdocs.
- 54:57Yeah, yeah, yeah.
- 54:58Just abuse the undergrads.
- 55:03here's a thousand images labeled right no right sorry undergrads are always gonna that's that's tough yeah it's a tough life we've all been there we all want those letters of recommendation you know you gotta you gotta work the sweat this is really interesting though because now there's the predictions are also on two very different planes
- 55:25Yes, that's a very good point.
- 55:26You know what I mean?
- 55:27Like in terms of what's... Yeah, because when we think about those three components of our city, right?
- 55:33The cerebral cortex is the homes and the businesses.
- 55:38That PV plus interneuron thing has to do with that part.
- 55:41Right.
- 55:42And then the...
- 55:45The brain imaging part, that one had to do with the thalamus and the relay stations.
- 55:50Correct.
- 55:50Right, right, right.
- 55:51So all three parts of the mesocircuit hypothesis are working together.
- 55:54And this thing is giving predictions, as you said, on all of them.
- 55:57Right.
- 55:58Right.
- 55:58Right.
- 55:59In very interesting ways.
- 56:01And again, this continues to go back to the fact that we have all these existing tools like transcriptomics.
- 56:06Mm-hmm.
- 56:10enables the ability to know what genes are being expressed yeah and one thing i just want to say is like to the team that that made this paper happen right i admire the resourcefulness right because it's one thing to have an ai model and make predictions right and it's another thing to think okay here are the predictions how can i
- 56:33make the argument that this is real.
- 56:34Right.
- 56:35How can I check?
- 56:36It's always about checking.
- 56:37Yes.
- 56:37And they were so resourceful that they found these kinds of data sets.
- 56:41You know, maybe they talked, I don't know exactly the details.
- 56:44I don't know if these are open or not, but you, you go talk to somebody who has that data set.
- 56:47Right.
- 56:47You meet someone at a conference and they're like, Hey, actually you can look into mine.
- 56:51Put me as an author You know so It's very clever I think that part is nice The whole from the ideation Of like let's give it a try To then how are we going to be able to Prove to reviewer two That this is not all nonsense Yeah yeah exactly I got lunch with Daniel about three weeks ago And he was telling me about this paper And he told me like The thing predicted this And the first thing I asked well yeah but like
- 57:21you know,
- 57:22How do you know the model isn't just bullshitting?
- 57:25And then he told me about these two techniques.
- 57:27I was like, okay, that's actually pretty dope.
- 57:29Yeah.
- 57:29Well, as soon as it's out, we'll cover it.
- 57:32You know?
- 57:34So, yeah, this was pretty cool.
- 57:36Okay, the final thing we're going to talk about is a proposed strategy for awakening patients with coma, right?
- 57:43Right.
- 57:43Because at the end of the day, that's what really matters.
- 57:46Clinically, that's how it started, and that's how we're going to end it.
- 57:50So...
- 57:51The intervention that they looked for and how to test was deep brain stimulation.
- 57:56This is, again, the idea of you test, you put in an electrode deep into the brain, and then you give it electrical activity.
- 58:04And you try to wake up the neurons, okay?
- 58:07Now, the researchers here, what they did was test a bunch of targets in their biophysical model and say, what if I provide stimulation here?
- 58:16What if I provide stimulation here?
- 58:17What's the best target in my three-component model, right?
- 58:22Because there's a bunch.
- 58:23There's cortex.
- 58:24There's thalamus.
- 58:24There's subthalamic nuclei.
- 58:26There's the palladium.
- 58:28And each of those has their own little subpopulations.
- 58:32So we can get really granular now, right?
- 58:35We can get really granular and try to think what is the best target.
- 58:39This is so good.
- 58:40They settled on the subthalamic nucleus.
- 58:43It had an overwhelmingly standout result for consciousness recovery in their model.
- 58:49Okay.
- 58:49Okay?
- 58:50Then again, they tested this with humans.
- 58:53They tested 130 hertz stimulation in the subthalamic nucleus in six awake human patients.
- 59:00And the cortical CNN, the cortical consciousness detector that they had previously trained, detected a significant shift towards optimal consciousness.
- 59:14This is crazy.
- 59:15With only stimulation in the STN.
- 59:18If they went anywhere else, only the sub-dilemic nucleus showed this effect.
- 59:21If they did it in the cortex, if they did it in the palladium, didn't show any significant increase in consciousness.
- 59:27Yes.
- 59:28And that's what the model predicted.
- 59:29So are you saying we found the boss's office?
- 59:32Yeah, it seems we found... We may have found the boss's office.
- 59:35Where if you turn the lights on and off, the boss will wake up.
- 59:38Yeah, right, right, right.
- 59:41This is...
- 59:42I'm so mad because it's so clever.
- 59:45Each of the three layers, also in how we went through it, of like detection, characterization, and evaluation almost is like, is so good.
- 59:55Because I think...
- 59:57The part that's getting me about this piece is because you've set up like the genomic algorithm and the model, the brain simulator, the way they thought to set it up that way means that you almost have this like alpha fold adjacent kind of thing where you can in silica like test stuff.
- 1:00:18Yeah.
- 1:00:20To try to narrow the sandbox of where to look.
- 1:00:24Exactly.
- 1:00:24Right?
- 1:00:25And, like, that's so valuable.
- 1:00:27Yeah.
- 1:00:27Yeah, exactly.
- 1:00:28It doesn't necessarily have to be the exact answer.
- 1:00:30No.
- 1:00:30But if it's even somewhat directionally correct, that's unbelievably valuable.
- 1:00:35Yeah, dude, it's great.
- 1:00:36And one thing that one thing that's kind of funny is so Daniel, he is himself a science communicator.
- 1:00:43Right.
- 1:00:43So he's got an Instagram and a TikTok.
- 1:00:45And he did like a short three minute video being like, hey, my paper came out and he kind of explained it at a very high level.
- 1:00:51I mean, here we've gone really in depth.
- 1:00:54So.
- 1:00:55At that high level, he was describing his generative AI framework, and there was someone in the comment who was like, that's not really AI, right?
- 1:01:01Because you're using a biophysical model.
- 1:01:03And it's like, dude, that's the point.
- 1:01:06That's the point.
- 1:01:06It's like without a biophysical model, I wouldn't be able to make these predictions of, oh, it's the PV plus neurons in the cortex.
- 1:01:13It's this highway in between the striatum and the palladium.
- 1:01:17It's the subthalamic nucleus that we need to probe, right?
- 1:01:21It's just going to be subthalamic.
- 1:01:22random neuron in some random layer of a trillion parameter model what good is that the the a hundred percent i still come back to one of the there's so many interesting insights in this entire papers architecture like the experimental design architecture but i think a key piece was uh
- 1:01:42You can get traceability and then subsequently reproducibility because of that brain simulator.
- 1:01:50Yeah.
- 1:01:52And the way in which it is explicit, it is...
- 1:01:59What's the, there's the terminology, and this may not be correct.
- 1:02:02There's this terminology where probabilistic versus deterministic, and it's more on the deterministic side and less on the probabilistic side, which in science, it's a good thing.
- 1:02:12Yeah, it's very much a good thing.
- 1:02:15And then finally we now have an idea that it should be the sub-dalamic nucleus that we target, which is this tiny, like, lentil-sized structure
- 1:02:24Right?
- 1:02:25It's actually also quite incredible if you think about it.
- 1:02:27Like, that is the boss's office.
- 1:02:29Right.
- 1:02:30Right?
- 1:02:30For at least stimulation of the brain.
- 1:02:32Consciousness could be a distributive thing.
- 1:02:34But just stimulating that tiny structure of maybe, let's say, hundreds of thousands of neurons at the max is going to wake up a brain that is 86 billion neurons.
- 1:02:47Right?
- 1:02:48Consciousness is a crazy thing.
- 1:02:50And we're getting closer to...
- 1:02:52So would it actually a correct analysis?
- 1:02:54Because there's going to be probably some thoughts about, oh, like consciousness is, like you discussed at the beginning, a very expansive thing.
- 1:03:03And really all we're identifying in this last piece is, I keep using the grill lighter example.
- 1:03:10This might just be the igniter, the little button you press on the grill to turn consciousness on.
- 1:03:16Yeah.
- 1:03:16But that's all we're saying right now.
- 1:03:19I don't know what the grill being on means.
- 1:03:21Right.
- 1:03:22We don't know how big the grill is.
- 1:03:23Is it a black stone?
- 1:03:24Yeah.
- 1:03:25Is it whatever?
- 1:03:27Exactly.
- 1:03:27We're just saying we may have found where we can wake an unconscious from this vegetative or unconscious state.
- 1:03:35Yes.
- 1:03:36And the interesting dovetail of how.
- 1:03:42The 2007 paper we talked about that identified this idea of minimally waking consciousness was actually a key step in order for this to actually also work because that was where we started to zoom in and be able to validate the mesocentric model.
- 1:03:59It's just like everything has to work.
- 1:04:03Yeah, one after the other.
- 1:04:04It has to stack.
- 1:04:05Right, yeah.
- 1:04:06In order for this to even be possible.
- 1:04:08Yeah.
- 1:04:08This was really quite nice.
- 1:04:09It was a good paper.
- 1:04:11Daniel does a lot of really cool work with Koma.
- 1:04:15He's actually also in an organoid lab at UCLA.
- 1:04:18So one of these days, we'll come by UCLA and see your lab, Daniel.
- 1:04:22But until then, nicely done.
- 1:04:24Very, very nicely done.
- 1:04:26Obviously, the...
- 1:04:28This is early, but there's a huge...
- 1:04:32The unlocks that are there, you know, you could talk about it forever, just in terms of not only the clinical or medical context, but even for the philosophy of mind kind of stuff, having some mechanistic details.
- 1:04:47Yes, that's big.
- 1:04:48And I think...
- 1:04:51The part that is going to be most influential for this paper is actually the way that he went about using this biophysical model.
- 1:05:02Yes, I totally agree.
- 1:05:03And tweaking.
- 1:05:04I totally agree.
- 1:05:04That's a very interesting way to do things.
- 1:05:07I totally agree.
- 1:05:08And I can already imagine...
- 1:05:11it being used for all sorts of stuff, material science, like physical things, you know, like we've got really good models about how atoms work with each other.
- 1:05:21Exactly.
- 1:05:22Make a GAN genetic network type thing, you know, like that is the part that is really like, I think mechanistically very interesting to me.
- 1:05:30The methods is very nice.
- 1:05:31I mean, obviously the results are incredible, but to me, the, the one I'm most impressed about is the way that he used this biophysical model.
- 1:05:39Um,
- 1:05:40As someone who's coming more from the technology and software world, it is naturally what I'm able to better engage in at a deep level.
- 1:05:52But I agree with you.
- 1:05:53I think they've basically created a conceptual framework around how to design things.
- 1:06:04ML and AI architecture as a, as an end to end system and process that is subject matter agnostic.
- 1:06:15Mm hmm.
- 1:06:16Yeah, yeah.
- 1:06:17Like it could work.
- 1:06:17Yeah, yeah, yeah.
- 1:06:18That thing can work.
- 1:06:19And a whole variety of – the brain was just the first target.
- 1:06:23But the exact same conceptual framework could work in a variety of different areas.
- 1:06:27Yeah.
- 1:06:27Particularly the data feedback loop and validation process, et cetera.
- 1:06:31Really, really – I just – this was great.
- 1:06:33Yeah, good stuff.
- 1:06:33Yeah.
- 1:06:34Well done, Daniel Toker et al.
- 1:06:36Again, this was in Nature Neuroscience on March 24th.
- 1:06:40Fresh hot off the presses.
- 1:06:42Again, there is nowhere else on the internet, not even on the direct pages of the authors themselves, where you're going to get this level of excitement, passion, and deep dive.
- 1:06:54They need a break.
- 1:06:54Daniel needs a break anyway.
- 1:06:55So it's our job to do this and step in.
- 1:06:58Yeah, we'll see what he thinks about it.
- 1:07:01You actually guys did pretty well.
- 1:07:02You did pretty well.
- 1:07:03No, just another fantastic paper.
- 1:07:05And we just really want to thank those of you who have stayed this long and listened to the episode for staying with us and enjoying this journey of curiosity and discovery.
- 1:07:18I will do a brief pause to ask if we would like to do a comment.
- 1:07:23for the audience.
- 1:07:26Gan.
- 1:07:27Gan.
- 1:07:28This has become our shtick.
- 1:07:29We can't think of anything.
- 1:07:32What's another alternate...
- 1:07:36full form of GAN.
- 1:07:37Yeah, acronym definition for what?
- 1:07:39Generative Adversarial Networks.
- 1:07:40Come on, you guys can think of something better.
- 1:07:42Something great.
- 1:07:43We really appreciate you all.
- 1:07:44My name is Lester Nare, joined as always by my co-host and our resident PhD, Krishna Chowdhury.
- 1:07:51This is the last reminder I'll make on this.
- 1:07:53We are moving to single-story episodes multiple times a week.
- 1:07:58We have gotten confirmation from our deep listeners that...
- 1:08:01You do appreciate it and you like it.
- 1:08:02And there was a good idea that we will think through.
- 1:08:06I don't know if actually, I don't even know if you saw this, but the rundown, when we do the rundown at the end of the week, we don't really go in depth.
- 1:08:14And there's a lot of folks who would like us to go in depth or any number of those particular stories.
- 1:08:19So,
- 1:08:20We will look into having basically a patron system to vote on what rundown story should we follow up on for a deep dive.
- 1:08:27It's a great idea.
- 1:08:28Excuse me for not remembering the commenter who said it, but you can comment again.
- 1:08:32We do see it.
- 1:08:32Thank you so much.
- 1:08:34We will see you all later this week.