Latest / From First Principles / Can Human Neurons Really Play Doom? The Science Behind Wetware (EP. 33)

Transcript

Can Human Neurons Really Play Doom? The Science Behind Wetware (EP. 33) · From First Principles

• 0:00
  It's called wetware engineering, and it's effectively neurons, human neurons, plus electronics.
• 0:07
  So you cut out the middleman.
• 0:08
  The learning mechanism is literally minimizing surprise.
• 0:12
  If, on the other hand, it misses, it's going to get four seconds at 20 volts of highly chaotic electrical activity.
• 0:21
  So now I can very easily ask, who is actually doing the learning?
• 0:25
  Correct.
• 0:26
  Is it my reinforcement learning mechanism?
• 0:28
  Network, or is it the actual biological neurons that I have?
• 0:30
  Doesn't count.
• 0:32
  Hello, Internet.
• 0:32
  This is your captain speaking, Lester Nare, joined as always by my co-host and our resident PhD, Krishna Chowdhury.
• 0:42
  And today we're going to be talking about a topic that sounds like it's something straight out of science fiction, which is, did a dish full of human neurons successfully play Doom, the video game?
• 0:57
  Now, this is something that has been hyped in the news over the last two to three weeks with everyone trying to understand, is this real or is this hype?
• 1:06
  We're going to dive into the origins of how this came about through a research paper in Neuron out of Cortical Labs in Melbourne, Australia, published in 2022.
• 1:16
  Okay.
• 1:18
  And look at that paper versus the recent news.
• 1:22
  And we might even touch on some of the other big fundamentals that made this concept possible.
• 1:29
  We are going to learn about the science from the ground up today because this is From First Principles.
• 1:51
  So in our world of AI, we are very much used to artificial neural networks, right?
• 1:58
  And these are biomimetic AI in the sense that they mimic biology, right?
• 2:07
  Biological brains became artificial neural networks.
• 2:11
  The subject of this deep dive today is about a possible transition from this biomimetic AI to straight-up biocomputing.
• 2:19
  It's called wetware engineering, and it's effectively neurons, human neurons, plus electronics.
• 2:26
  So you cut out the middleman.
• 2:27
  You don't even make any artificial neurons.
• 2:29
  You're using now biological neurons to help you in computing.
• 2:34
  Specifically, there's an Australian company called Cortical Labs.
• 2:38
  They were recently in the news because their wetware computer could play Doom.
• 2:43
  And it was all hype, right?
• 2:45
  I've seen it literally everywhere.
• 2:49
  Yeah.
• 2:49
  The tech bros are going crazy.
• 2:52
  Yeah.
• 2:52
  All the doomsday people are like, should we be doing this?
• 2:54
  Right.
• 2:55
  So, you know, I naturally asked how much of this is real and how much of this is hype.
• 3:00
  And it turns out there's a lot of both.
• 3:03
  Okay.
• 3:04
  And that's what we're going to get into.
• 3:05
  Okay.
• 3:05
  Okay.
• 3:06
  So let's do a little bit of brief background.
• 3:09
  Okay.
• 3:10
  Let's talk about the biological neuron, the one that is the substrate of our own nervous system in our human brain.
• 3:16
  A biological neuron is a cell, a biological cell.
• 3:20
  We see that on the left here.
• 3:22
  It's got a cell body.
• 3:24
  It's got dendrites, which are where other neurons come in and give you input.
• 3:30
  And in the cell body, what you do is you integrate, meaning you sum up all the inputs.
• 3:39
  exceeds some kind of threshold, then you fire what's called an action potential, which is, in other words, a spike.
• 3:46
  It's effectively saying my neuron went from off to on because all of the other neurons that were talking to me, there were enough.
• 3:54
  There were enough neurons that were talking to me with enough input that I decided to go from off to on.
• 4:00
  When I do that, I go downstream and the action potential goes downstream to other dendrites of other neurons.
• 4:06
  And that's how we get
• 4:09
  a biological neuron.
• 4:10
  Now, in the artificial neuron, very much similar.
• 4:13
  You've got incoming neurons and their activity.
• 4:18
  The GPU of NVIDIA sums that up and then fires if it fires like, you know,
• 4:26
  an output to downstream neurons if the input exceeds a certain threshold, right?
• 4:33
  So we've basically taken the biological thing, and we've turned it into a very simple math equation.
• 4:38
  Now, obviously, in that approximation, we're not doing it complete justice because in biological neurons, there's structure, there's proteins, there's all sorts of little things, and it's not really just straight-up integrate and fire, though that's the simplest kind of...
• 4:53
  model that you can create.
• 4:55
  But it turns out for a lot of the AI that we see, I mean, it's doing pretty well, right?
• 5:01
  So even though we sort of have a simplification of this representation of biological neurons in our artificial neural network systems...
• 5:11
  even that simple approximation in and of itself has valuable, productive outcomes.
• 5:19
  Yes.
• 5:19
  We don't have to replicate the whole of the brain in order to get some benefits from the concept.
• 5:27
  Exactly.
• 5:27
  And the reason why is because of the neural network, the idea that we can connect a bunch of these neurons together.
• 5:34
  into a giant network where everything is connected to one another.
• 5:38
  Not everything is connected, but you can have layers of connections from one to the other.
• 5:42
  So in the biological case, again, on the left, you've got one neuron that's connected to the other.
• 5:46
  So the output of one neuron is connected to the dendrites of the other through something called a synapse.
• 5:51
  That's the gap in between neurons that let the neurons talk to one another.
• 5:55
  And in the artificial case, you've got hidden layers of neurons.
• 5:59
  And from one layer to the next, you've got...
• 6:01
  inputs going in.
• 6:03
  Again, each neuron is going to integrate, meaning sum up and then fire if it exceeds some threshold.
• 6:09
  So you've got these nonlinearities, and then that's going to create the output, which is going to create the next output, which is going to create the next output.
• 6:15
  And if you have trillions of parameters and, you know, millions and billions of neurons, then you can actually approximate any function you want, including, let's say, thought.
• 6:24
  And that's how you get large language models and all sorts of very, very cool things.
• 6:28
  So that's how
• 6:29
  We've mostly done artificial neural networks, right?
• 6:34
  Now, how is the brain different from these artificial neural networks?
• 6:40
  That's something that we should focus on here.
• 6:42
  Because these guys are trying to use biological neurons.
• 6:45
  If the artificial neural network is just that good, why would we want to try to use biological neural networks?
• 6:50
  There is an advantage that cortical labs and other people doing this technology say.
• 6:58
  The idea is silicon models, which are the things in NVIDIA and things like that, they use the von Neumann architecture of computing.
• 7:06
  The biological brain is just the biological brain.
• 7:08
  The von Neumann architecture is the following.
• 7:12
  Your processor is separate from your memory, right?
• 7:16
  The memory is where you store stuff.
• 7:18
  The processing is where you compute.
• 7:20
  Those are two separate things in a conventional computer, right?
• 7:23
  You've got your, like, RAM, and then you've got your CPU.
• 7:26
  And over the years, there's a huge gap between how fast you can compute things in your CPU or your GPU and how fast you can access the memory where you store stuff.
• 7:38
  In the brain, both are co-located.
• 7:40
  Okay.
• 7:41
  They're the same thing.
• 7:41
  They're all stored in the synapses, the weights of these things.
• 7:44
  The memory itself is stored in the weights, right?
• 7:47
  And the way that you process stuff is you go from one neuron to the other in this neural network.
• 7:53
  But in an artificial neural network, there's that difference, right?
• 7:57
  So the idea is that perhaps this gives the brain an advantage.
• 8:03
  Another advantage that the brain has is that it's massively parallel.
• 8:07
  And it only uses like 12 to 20 watts of power for 100 billion neurons.
• 8:11
  On the other hand, state-of-the-art GPUs and neural nets use gigawatts of power for computing, right?
• 8:17
  So there's a clear difference also in the amount of energy needed to create that computing.
• 8:25
  So the differences between the two, one is efficiency.
• 8:29
  We've created a simplified abstraction of what the brain does.
• 8:33
  And it takes a lot more energy to even do some of the things that the brain does.
• 8:38
  So it's a highly inefficient abstraction.
• 8:41
  As compared to the brain, naturally, artificial intelligence is highly inefficient or highly energy consumptive.
• 8:47
  Yes.
• 8:50
  Also, the way in which the brain is structured, it can do significantly larger amounts of parallel processing.
• 9:00
  Yes.
• 9:01
  Which enables that energy efficiency in part.
• 9:04
  Yeah.
• 9:04
  And also like each neural, each neuron itself is like highly efficient as a computational unit.
• 9:10
  Right.
• 9:10
  It doesn't require a lot of energy.
• 9:11
  We think, you know, our brain does consume 20% of the energy of our body.
• 9:16
  But still, that's not actually a lot when you think about things.
• 9:19
  Right.
• 9:19
  So perhaps the idea is we can use this natural biological wetware.
• 9:24
  in place of our von Neumann architecture hardware, the GPUs that take up all that energy.
• 9:29
  That's the argument, okay?
• 9:31
  But in order to do that, we need to be able to read and write to biological neurons.
• 9:36
  Right, and also where do these biological neurons exist?
• 9:39
  Yeah, yeah.
• 9:40
  Where do they come from?
• 9:41
  They're usually in our brain, right?
• 9:42
  So let's get into how we actually read and write to real biological neurons in a dish.
• 9:48
  This was actually pioneered in 1972 by Thomas G. Pine at Caltech when he developed the first multi-electrode array.
• 9:57
  Here's the idea.
• 9:58
  So neurons produce electricity when they talk to one another.
• 10:01
  That's how they talk.
• 10:03
  They use ion channels, which are...
• 10:05
  little holes in their membranes, the boundary between the inside and the outside of the cell.
• 10:11
  And when those little membrane proteins, those channels open up or close, that facilitates the transfer of ions like potassium ions, chlorine ions, sodium ions, from the inside to the outside of the cell.
• 10:24
  Ions are charged atoms in some sense.
• 10:27
  And so when they move around...
• 10:29
  they're going to create electricity.
• 10:30
  They're going to create electric fields.
• 10:32
  And we can sense that if we have an electrode array, which is just a bunch of tips of metal that is connected to some kind of amplifier.
• 10:40
  And as each neuron produces a little electric field blip, I can sense that with my electrode array, right?
• 10:48
  I can also supply electricity
• 10:50
  to then influence the behavior of the neurons near my electrode.
• 10:54
  Like if I've got a little metal tip here and I supply electricity, that is going to change the electric field around that metal tip, which is then going to influence the ions and thus the proteins on that neuron that are nearby that metal tip.
• 11:08
  And so I can now toggle between on and off based on that stimulation.
• 11:12
  So I've got a read, which is when the neurons fire, they're going to release a little electric...
• 11:17
  field, you know, spike that I can read and then I can write by supplying electricity and that's going to influence the neurons around it.
• 11:24
  I have a quick clarifying question.
• 11:26
  Yeah.
• 11:26
  When you talked about the spike just now, you're referring to the concept you talked about earlier of the action potential.
• 11:33
  Yes.
• 11:33
  This sort of like surge of electrical signal that then the neuron utilizes to do its next action or its next step.
• 11:44
  And so when we have the ability to provide that
• 11:52
  energy or source material necessary for the neuron to trigger its action potential artificially.
• 12:01
  It's not only a capability that is not reproducible artificially.
• 12:06
  Yes, exactly.
• 12:07
  Yeah, it's something that we can we can provide a signal to whatever metal contact is near that neuron.
• 12:13
  And then, you know, that's going to create a change in electric field, which is going to then drive ions around that neuron.
• 12:19
  It's going to drive the proteins around that neuron.
• 12:21
  And then the neurons will be sensitive to that change in the electric field.
• 12:25
  Right.
• 12:25
  They're going to think that it's another neuron somewhere.
• 12:28
  That's like doing that.
• 12:29
  So we've to just make a fine point on it.
• 12:32
  We can translate into the language that these neurons speak using this kind of methodology.
• 12:39
  Yes, exactly.
• 12:40
  Yes.
• 12:40
  So now we can read and write.
• 12:42
  Yes.
• 12:42
  OK, so can we do biocomputing?
• 12:44
  Well, early biocomputing actually started in the late 1990s, early 2000s.
• 12:49
  There was this guy, Steve M. Potter.
• 12:51
  He was at the Georgia Tech, Georgia Institute of Technology.
• 12:58
  which is a hybrid robot, he used cultured cortical neurons from rats on a multi-electrode array to actually do just, to control like a robot.
• 13:09
  Okay?
• 13:09
  So again, this is a little plate that has a bunch of
• 13:13
  silicon electrodes let's say it could be something else i don't actually know what what but today we use a lot of silicon in our electrodes obviously um and he could grow rat cortical neurons on that electrode like in a petri dish and then sense and then write you know so you've got to read in and then uh write out you can listen to what's happening and you can talk to it to tell it stuff
• 13:39
  Yeah, yeah.
• 13:40
  So this was him controlling a robot.
• 13:41
  In 2004, this was in the news.
• 13:43
  That was pretty cool.
• 13:44
  Thomas DeMars cultured 25,000 rat cortical neurons in a Petri dish, and that acted as an autopilot for an F-22 flight simulator.
• 13:54
  This was all over the news as well back then.
• 13:57
  And so that's pretty cool, right?
• 13:59
  Like almost 20 years ago, more than 20 years ago, 30 years ago is when we're doing this stuff.
• 14:03
  So how come now is when we can actually...
• 14:08
  Play video games.
• 14:09
  Okay.
• 14:10
  The reason for that is, one, we've had a huge improvement in how many electrodes we can fit inside our multi-electrode array.
• 14:20
  Back then, we could only fit about 60.
• 14:22
  Now we can do thousands.
• 14:24
  So we can sense a lot finer detail.
• 14:27
  The bandwidth is greater.
• 14:28
  Yeah, yeah.
• 14:28
  It's like the density of the electrodes is literally greater.
• 14:31
  We can make them smaller.
• 14:32
  We can make them more sensitive.
• 14:34
  So we can now sense individual neurons rather than global populations.
• 14:38
  The other thing is that we need to keep these neurons alive, right, in the Petri dish.
• 14:44
  And we've had a tremendous amount of...
• 14:47
  scientific innovation in how to keep neurons in a petri dish alive for an extended period of time right so now with all of that we can get to cortical labs which is a new startup that came out of australia that is doing this stuff that is trying to make neurons in a petri dish play pong and now most recently play doom but before that allegedly allegedly we'll see right we'll see
• 15:12
  Before that?
• 15:13
  We are just so grateful and excited for so many of you that continue to join us on this journey of curiosity and discovery.
• 15:22
  For those of you who are returning, welcome back.
• 15:25
  We greatly appreciate your attendance at our multi-week now show release schedule.
• 15:32
  As we mentioned in our previous episodes, we are now testing going from just doing one weekly episode to multiple, with the rundown being it's on episode type.
• 15:41
  So if you're looking at your podcast feed or your Spotify feed and you're like, what's going on?
• 15:47
  You're getting more of us more often, which has been in high demand.
• 15:51
  And if you do like what you hear, whether you've been here with us for a long time or you're a new listener, one of the greatest ways that you can support the show is to give it a like, share, comment, follow on the platform that you happen to discover us on or listen to us on.
• 16:06
  And if you want to go above and beyond, we do have a donation portal at the website ffppod.com backslash donate where you can support the show with a recurring or one-time donation.
• 16:20
  We are a two-man operation.
• 16:22
  We've set up this unbelievable organization.
• 16:25
  production through the ingenuity of the both of us.
• 16:30
  And it is really a pleasure to be able to talk to you guys about the wonders of science multiple times a week.
• 16:36
  And we just, again, really, really, really cannot express how important it is to fight the billionaire algorithm
• 16:43
  to just engage in any way that you can, even if it's not financially, it's really helpful for us to get to more people so we can talk about the wonders of what the researchers and scientists all over the globe are providing us in terms of the future of humanity.
• 17:00
  And with that housekeeping note, we can jump back into Cortical Labs.
• 17:04
  All right.
• 17:05
  So now let's talk about Cortical Labs.
• 17:07
  This is the subject.
• 17:08
  This is a startup out of Melbourne, Australia.
• 17:11
  I just recently watched the Formula One Grand Prix in Melbourne.
• 17:16
  Ferrari.
• 17:16
  No, it didn't.
• 17:18
  Mercedes is.
• 17:19
  Was that the one where Leclerc and Hamilton were battling each other?
• 17:23
  No, that was the Chinese Grand Prix very recently.
• 17:25
  Anyways, I don't want to talk about it.
• 17:27
  um cortical labs founded in 2019 by hongwen chong the company gained international attention in 2022 because of a paper that we're going to cover it was in the journal neuron and it was describing this thing called dish brain which is a system in which in vitro neural cultures so that's in vitro meaning in a petri dish learned how to play the game pong in a closed loop environment
• 17:52
  Okay?
• 17:53
  So that is the paper that we are going to be talking about because that is the bedrock upon which their technology is built, and it'll help us understand how exactly they did do.
• 18:03
  Okay?
• 18:04
  And it's actually very cool, some of the stuff that they've done.
• 18:07
  Okay?
• 18:08
  So, first of all, you got to get neurons for your wetware engineering.
• 18:14
  Yes.
• 18:14
  How do you get neurons?
• 18:15
  Well, first you get primary mouse cortical neurons.
• 18:18
  Those are...
• 18:20
  fine to get.
• 18:21
  You know, mice are very much a animal that we use in biological research.
• 18:26
  So that's not that hard.
• 18:28
  Human cortical cells, on the other hand, are hard to come by.
• 18:31
  So instead of actually, you know, waiting for a patient who has epilepsy, let's say to have a little part of their brain excised and get that kind of cortical neuron, you never know with those kinds of samples, like, okay, it's a brain that has epilepsy.
• 18:43
  That's not a wild type.
• 18:44
  type brain it's not a neurotypical as we should say type brain so instead what what they did was they generated human induced pluripotent stem cells this is something that we cover a lot it won the nobel prize because it's a technology where we can take somatic cells like stuff from the biopsy of a of skin we can reprogram them to become stem cells which are blank slate cells that can be anything that they want and then we can
• 19:11
  Give them a cocktail of chemicals to differentiate them into cortical tissue.
• 19:17
  So we take skin cells, we make them a blank slate, and then we make them cortical neurons.
• 19:22
  I just want to make a quick note that this was, I think this was the Yamanaka.
• 19:26
  Yes.
• 19:27
  Yeah.
• 19:27
  And this was really important because prior to that, embryonic stem cell research was highly controversial and it was the only way to acquire stem cells.
• 19:36
  And it really unlocked the ability to actually be able to do this type of work by removing the sort of moral, ethical issues.
• 19:44
  Yeah.
• 19:44
  Conundrum.
• 19:45
  So now the point being any human cell, you can reprogram to something else.
• 19:49
  Yeah.
• 19:49
  That wasn't, that's where, you know, that's a huge, that's a huge foundational discovery.
• 19:55
  Exactly.
• 19:55
  That, that now, cause I, I know the sort of stem cell piece for some folks, it's like they, they're that,
• 20:02
  historical point because some people still think oh aren't we still getting those from embryos no yeah this is just your skin cell becoming a stem cell it's pretty insane now of course with the pluripotent stem cells it's not a complete blank slate right the embryonic stem cell is like the gold standard because those things
• 20:19
  are built to be blank slates, right?
• 20:21
  So, but this comes pretty close for literally 90% of applications.
• 20:26
  So it's done a huge service for the biomedical industry because for 90% of applications, I don't need to worry about that.
• 20:34
  That's still a huge unlock.
• 20:35
  Yes.
• 20:35
  I just want to be very clear here.
• 20:37
  So let's talk about the culture that they made.
• 20:40
  They made 800,000 neurons.
• 20:42
  Co-cultured with astrocytes.
• 20:44
  This is pretty incredible here.
• 20:46
  Usually when we make stem cells, right, and we make a culture of cortical tissue, you're going to have all neurons.
• 20:53
  That actually is not ideal.
• 20:55
  Okay.
• 20:56
  For certain applications, it is.
• 20:57
  Like when we were discussing the ALS story.
• 21:00
  Yes.
• 21:00
  And we wanted to create an ALS mini brain on a Petri dish.
• 21:05
  We wanted it to be all motor neurons, right?
• 21:08
  Because then that's how we test the drugs and so on and so forth.
• 21:11
  In this case, we want like a live computing unit.
• 21:15
  Mm-hmm.
• 21:15
  That kind of mimics the human brain, like, or at least a small chunk of the human brain.
• 21:20
  And the human brain is not just neurons.
• 21:22
  The human brain has astrocytes.
• 21:24
  So if we look over here, what they've been able to do is grow neurons along with astrocytes and all of the supporting cells.
• 21:33
  Okay?
• 21:34
  So the blue, that DAPI.
• 21:37
  Yes.
• 21:38
  Yes.
• 21:39
  Those are marking the neurons.
• 21:41
  The GFAP and the red, those are marking supporting astrocytes.
• 21:45
  And those are critical for long-term functioning.
• 21:48
  Okay.
• 21:48
  Okay?
• 21:49
  So this is sort of a secret sauce that allows those cultures in that Petri dish to survive for a lot longer.
• 21:55
  So now they can learn over a longer timescale.
• 21:59
  And, you know, actually now we can take neurocomputing seriously.
• 22:04
  Okay.
• 22:04
  If you have a professional sports team with these high-skill athletes, they're nothing without the training and medical staff that enable them to continue to perform over longer periods of time given the amount of stress and things that are going on.
• 22:20
  Exactly.
• 22:20
  And so these are all these supporting cells which are crucial to creating a compute, like, you know, a little piece of computation on that Petri dish.
• 22:29
  It's not just all neurons.
• 22:30
  You've got to have sort of a mimicked brain environment.
• 22:33
  And they were very successful at doing that.
• 22:35
  So now that's the side of the cells.
• 22:38
  We've created a really nice culture with 800,000 neurons.
• 22:41
  That's a lot of neurons.
• 22:42
  Right.
• 22:43
  Okay.
• 22:43
  Now let's go into the multi-electrode array.
• 22:47
  I'm sorry.
• 22:47
  I just want to interrupt you really briefly.
• 22:50
  So the 800,000 neurons, would that be comparable to saying like the GPUs in your NVIDIA cluster as like the corollary in an artificial system?
• 22:59
  Yeah.
• 22:59
  Yeah.
• 22:59
  It's like the number of...
• 23:02
  It's the number of transistors one can think of.
• 23:04
  Okay.
• 23:05
  Maybe.
• 23:05
  Maybe.
• 23:06
  Maybe.
• 23:07
  No, it's not quite because it's not one transistor to one artificial neuron.
• 23:11
  But in your artificial neural network, you have billions and billions of neurons with trillions of weights in between them.
• 23:18
  Here you've got 800,000 neurons.
• 23:20
  It's still small, but it's incredible what they're able to do with it.
• 23:23
  Understood.
• 23:24
  You know?
• 23:25
  But that's the idea.
• 23:26
  Yes.
• 23:26
  You know?
• 23:26
  Okay, so that's our neuron piece.
• 23:28
  Now let's get into how are we going to sense them.
• 23:30
  That's our multi-electrodes, right?
• 23:31
  Those are the little metal leads that let us read the neurons and then write to the neurons.
• 23:38
  So here they did a high-density multi-electrode array using CMOS technology, 26,000 platinum electrodes.
• 23:45
  What you can see over there, all of these little rectangles is an individual electrode.
• 23:49
  Right.
• 23:50
  So that can be individually tuned to have voltage, you know, 5 volts, negative 2 volts, whatever you want it to be.
• 23:56
  It can read the electric field around it, and it can write an electric field around it.
• 24:02
  Okay?
• 24:03
  And you can see the sort of—this is a—I think it's an electron microscope.
• 24:08
  And you can see the cell bodies and all the dendrites and all of the connections that are just sort of growing—
• 24:14
  through that multi-electrode array.
• 24:16
  So when I have a connection, like a little axon that's connected from neuron A to B, I can follow that signal with my electrodes.
• 24:23
  Yes.
• 24:24
  Very, very cool, right?
• 24:25
  It looks like a map of LA from the sky.
• 24:27
  Yeah, yeah, it really does.
• 24:29
  The Spanish are very good at gridding, and that's what this looks like.
• 24:33
  If you're in Barcelona, it also looks like that, you know?
• 24:35
  Yes, yes.
• 24:37
  And out of the 26,000 platinum electrodes, there's only 1024 independent channels
• 24:43
  that are active okay so they can pick and choose which ones they want to read through right so that that's again a huge thing and one of the incredible things is that the latency between reading and then making a computation to figure out what to write right because i'm going to read the the the activity from the neurons then i'm gonna i don't know i guess like see what the game state of of pong is or doom is and then write back to the neurons and give them feedback and
• 25:10
  They got it down to five milliseconds.
• 25:12
  That's such a huge...
• 25:13
  Which is quite a small latency.
• 25:15
  Yes.
• 25:16
  If you really think about it.
• 25:17
  That is... And if we're trying to mimic the brain, we need that latency as close to zero as possible.
• 25:23
  Exactly.
• 25:23
  Because for us, our latency is around that.
• 25:27
  Right.
• 25:27
  Right?
• 25:29
  One of the common things that we think about is, like, our eyes are about 60 frames per second is the top level of how many, you know...
• 25:39
  little pictures it takes every second and relays back to our brain.
• 25:42
  And so 60 frames, let's just say 50 frames per second, because I want to make my math simpler.
• 25:47
  Yes.
• 25:48
  Right.
• 25:48
  So 50 frames per second, that's about 20 milliseconds is the, is the refresh rate.
• 25:54
  Yes.
• 25:54
  Yes.
• 25:55
  of my eye to the brain, right?
• 25:57
  And this is going down to five milliseconds.
• 25:59
  So it's even lower than that.
• 26:01
  That's the speed at which neurons talk.
• 26:03
  The action potential, which is this thing that I was telling you about when the neuron turns off, it actually immediately turns off right after.
• 26:09
  It turns on and off.
• 26:10
  And that action potential takes about one millisecond.
• 26:14
  So getting it down...
• 26:16
  is mimicking the sort of computational latency that the brain already has and what these neurons in your dish are used to.
• 26:23
  Yes.
• 26:23
  Right?
• 26:23
  So you don't have them, like, thinking harder than they need to.
• 26:27
  Than they need to, which makes it more energy-filled.
• 26:29
  Yeah.
• 26:30
  So now let's look at the dish-brain protocol.
• 26:33
  How do we play Pong with our...
• 26:37
  Video game.
• 26:37
  With our DBP.
• 26:39
  Yes.
• 26:40
  Okay.
• 26:40
  So over here, we've got in the middle our Petri dish that has on the bottom of it this multi-electrode array.
• 26:47
  These are little tiny electrodes that are going to sense the neuron culture that is on top.
• 26:51
  The neuron culture on top is getting bathed with electrolytes with glucose to keep it alive.
• 26:57
  They can keep it alive for as long as six months.
• 26:59
  And as these neurons in my Petri dish turn on and off, my multi-electrode array is going to sense that.
• 27:05
  It's going to read it in.
• 27:06
  It's going to sense the gameplay, and it's going to read it out into the neuron.
• 27:10
  Now, what we don't want to do is completely jumble up our read-in and our read-out.
• 27:17
  That was literally going to be my—the orchestration problem there is non-trivial.
• 27:21
  Right?
• 27:21
  Yeah, because we've got a bunch of electrodes, and the brain is not really an all-read-in, all-read-out, right?
• 27:28
  There are regions in the brain, like the occipital lobe that has the visual cortex—
• 27:34
  there's the prefrontal cortex that makes decisions.
• 27:37
  There's the motor cortex that actually outputs my hand when I'm like, let's say using a joystick, right?
• 27:43
  So there are segregated spots in my brain for where I'm reading in.
• 27:48
  That'll be my visual cortex and where I'm going and reading out.
• 27:52
  That would be my motor cortex.
• 27:53
  So they decided to create an artificial cortex,
• 27:57
  visual cortex and a motor cortex on the chip itself.
• 28:01
  Okay?
• 28:01
  So at the very top, on the right-hand side, what you can see is the electrode layout schematic.
• 28:06
  Okay.
• 28:06
  So you've got your rectangular...
• 28:10
  multi-electrode array that has 1024 electrodes that I can actively read out and read in from.
• 28:16
  On the very top, I'm going to make a rectangular box that's in the upper half, and eight of those electrodes I'm going to use as my, quote, visual cortex.
• 28:25
  It's really quite a sensory cortex, I should say, because that's what I'm...
• 28:30
  Writing into, right?
• 28:32
  The sensory cortex is getting information.
• 28:35
  When I play a video game, the sensory cortex is through my eyes and through, I guess, sound sometimes, getting information about the state of the game.
• 28:44
  If you talk to Call of Duty players, sound is as equally important.
• 28:48
  Yeah.
• 28:48
  With their high-quality headphones to sneak up on you as visual.
• 28:51
  Yeah.
• 28:52
  I'm just being annoying.
• 28:52
  I mean, when I was playing Halo, I used to sometimes have to, like, play on mute because I was, like, 2 a.m. And my parents were like, what are you doing?
• 29:01
  So I'm actually quite good at playing Halo on mute.
• 29:04
  So I don't know about you guys.
• 29:05
  But anyways, the idea is there's a sensory cortex that is getting information.
• 29:10
  Yeah.
• 29:10
  From the brain.
• 29:11
  So I'm going to just arbitrarily make that top half of my electrode, the sensory cortex, and that's where I'm going to write information to my neurons.
• 29:20
  And the idea here is we're segregating it from other section or sections such that it only has one thing to worry about.
• 29:27
  Yeah, exactly.
• 29:28
  It's kind of like, I mean, I don't want to give too much agency to these neurons in a dish.
• 29:34
  But what I'm saying is that those neurons in that upper half of my Petri dish,
• 29:39
  are acting like the sensory neurons they're going to sort of understand that hey i'm getting information about something and i think this goes back to the point you brought up earlier which is proximity creates stronger neural connections yes and so because you're putting them in proximity and having a similar input yeah the theory is you know they will naturally strengthen around that shared yes idea
• 30:03
  Very good.
• 30:03
  Yeah, exactly.
• 30:04
  Those neurons in that region, they're all connected to one another.
• 30:07
  And so they're going to somehow figure it out.
• 30:09
  Right.
• 30:10
  We're going to get into how, but that's the idea.
• 30:12
  They're going to somehow figure it out.
• 30:13
  And actually, if we put that back, the bottom half of that Petri dish has those up and down arrows.
• 30:20
  Yeah.
• 30:20
  That's my motor cortex.
• 30:22
  Okay.
• 30:22
  Okay.
• 30:23
  So neurons in the down region in that little block.
• 30:28
  If those fire, that's going to trigger my Pong paddle, I guess.
• 30:33
  It's a paddle, right?
• 30:34
  It's like a digital paddle.
• 30:35
  I know what you mean.
• 30:36
  You know what I mean, right?
• 30:37
  It's going to trigger the paddle to go down.
• 30:40
  And if the neurons in the up region fire for those electrodes, then it's going to trigger the neurons to go up.
• 30:47
  And sometimes you will have to calculate a difference between the up and down because, you know, maybe there's more...
• 30:52
  neurons in the down region versus the up.
• 30:54
  So I also have to normalize based on how many neurons there are, because I don't want to just artificially keep going down if there's randomly more neurons in that region.
• 31:02
  So there's a bunch of mathematical tricks you have to do, but at the end of the day, segregated regions, one set of neurons is going to fire if
• 31:10
  the culture wants to go down, and one set of neurons is going to fire if that petri dish culture is going to want to go up.
• 31:16
  Yes.
• 31:16
  Okay?
• 31:17
  So now we've figured out our read and our write mechanism.
• 31:20
  The write is the sensory cortex at the top, eight electrodes, and our read is getting it in.
• 31:26
  And I think an interesting point about this is that geographical or locational, where it's located and how it's segregated, like form is function, or form is following function in this context.
• 31:38
  Exactly, yeah.
• 31:39
  Now, there's one other thing that I want to touch upon, which is how exactly that writing mechanism is being implemented.
• 31:46
  Yeah.
• 31:46
  Right?
• 31:46
  Because what do we need to give this Petri dish of neurons information about?
• 31:51
  Yes.
• 31:51
  What is all the information we need to give it?
• 31:53
  Well, we need to give it a state of the game, right?
• 31:55
  Which is where is the paddle and where is the ball, right?
• 31:59
  In relation to that.
• 32:00
  Yes.
• 32:00
  Yes.
• 32:01
  Now, for us, when we play Pong, we've got a very nice visual system.
• 32:05
  So we see where the paddle is.
• 32:06
  We see where the ball is.
• 32:07
  And we also see how it's moving.
• 32:10
  And so we can sort of all of our billions of neurons in our brain can like understand spatially what's going on because we understand space because we've had so much pre-training.
• 32:20
  Yeah.
• 32:21
  And we can figure it out.
• 32:23
  Yeah.
• 32:24
  This is a neuron in a Petri dish.
• 32:25
  It does not have eyes.
• 32:26
  It does not have senses.
• 32:28
  We are creating the senses.
• 32:29
  So how are we going to do it?
• 32:30
  Well, they use something called rate and place coding.
• 32:34
  This is something that is very commonly observed in science.
• 32:39
  The human brain.
• 32:40
  Okay.
• 32:40
  Okay?
• 32:42
  For example, let's take the example of the human cochlea, which is in our ear.
• 32:46
  That's how we sense sound.
• 32:48
  We sense frequency.
• 32:50
  And we sense loudness.
• 32:51
  Right?
• 32:53
  I've touched upon the cochlea before.
• 32:55
  The idea with the cochlea is there's like this tube, a snail-like tube, that is embedded in our ear.
• 33:03
  Right?
• 33:04
  And what that tube is, if you were to unravel it, there would be neurons that are very thick at one end, and there would be neurons that are very thin at the other end.
• 33:12
  This thing gets wrapped up into kind of like a shell shape, right?
• 33:16
  But if I hear sound of a certain frequency, that is going to...
• 33:22
  excite a neuron along this axis that is at exactly the right thickness, right?
• 33:27
  If the sound is very low frequency, like a bass sound, that's going to excite the thicker neurons because they're bigger and the wavelength of the sound is bigger.
• 33:36
  So it's kind of just like, you know, the resonance is happening.
• 33:40
  And if the sound is really high, then it's going to...
• 33:44
  Excite the smaller neurons in my cochlea.
• 33:46
  Yes.
• 33:47
  So that's a place coding.
• 33:48
  That tells me the frequency.
• 33:50
  Okay.
• 33:50
  Okay.
• 33:50
  That's my place because my place along the axis is telling me the frequency of the sound.
• 33:56
  Yes.
• 33:56
  The rate coding is how loud is that sound?
• 33:59
  There it is.
• 34:00
  Because if it's very loud, then that neuron is going to fire at a very high frequency.
• 34:05
  If it's not that loud, it's going to fire at a low frequency.
• 34:08
  So I'm getting two pieces of information with place and rate.
• 34:12
  The place is telling me the frequency.
• 34:14
  The rate is telling me the loudness.
• 34:16
  And this is something that is very common in biology.
• 34:19
  Where the neurons are firing tells us one piece of information.
• 34:23
  And how much the neurons are firing tells me another piece of information.
• 34:27
  And those are simultaneously present in the world.
• 34:29
  when biological neural networks create computation.
• 34:34
  And just to continue to bring this back to the artificial comparison, I think what's interesting here is this is different than just being zeros or ones.
• 34:44
  Yes.
• 34:44
  Because you actually have two levels of input.
• 34:47
  You have the place, which you could...
• 34:52
  Let me not make that direct comparison.
• 34:53
  But the point is it is not as simple as a binary system.
• 34:56
  Yeah.
• 34:56
  It's more like of a two-state modulator.
• 35:00
  Yeah.
• 35:00
  No, I think you're on to something here in that the neuron is kind of an analog system, right, in that sense.
• 35:06
  Now, some people will argue that the neurons are still digital because they are sending out spikes.
• 35:12
  And if you were to condense time and discretize it into smaller and smaller segments—
• 35:18
  Then in each time window, the neuron is either active or inactive, right?
• 35:22
  And the idea of a high rate is just there's more time windows that it's active, right?
• 35:27
  So there is a really healthy debate in the neuroscience community about whether to interpret neurons as analog or digital, right?
• 35:36
  And I don't know where I fall on that.
• 35:38
  Okay, that's fair.
• 35:39
  But I think it's a fair point that you're making.
• 35:42
  Like, it's a very important point.
• 35:44
  Right, right, right.
• 35:45
  It's like that is still up for grabs.
• 35:47
  Because the answer to that will also then be relevant to, like, our conversation about LLMs versus other models that we had in the last episode in terms of if...
• 35:59
  Anyway, you get the idea.
• 36:00
  Yeah, yeah.
• 36:01
  So, to be clear, I just want to reiterate here.
• 36:06
  What we're doing is using something that is in place and something that the brain is already used to, which is place and rate coding.
• 36:13
  In the idea of the cochlea, the place along this axis was the frequency and the rate at which that neuron fired was the loudness.
• 36:22
  In this case, how are we actually, if we go back to photo 14, actually, how are we actually going to use that sensory frequency?
• 36:32
  Cortex, the eight electrodes that we're trying to write in our information.
• 36:36
  How are we going to use place and rate coding to inform my Petri dish brain about the state of the game?
• 36:43
  That's the key, right?
• 36:45
  What they did was they said something very interesting.
• 36:49
  The where the ball is or where the sorry, where the paddle is.
• 36:57
  Yes.
• 36:58
  is going to be my place.
• 37:01
  Okay?
• 37:01
  So if my paddle is lower on the screen, I'm going to fire the electrodes on the left.
• 37:08
  I'm going to make the left electrodes give some electricity to my brain.
• 37:13
  If the paddle is up on the screen, I'm going to give the right electrodes.
• 37:17
  Okay, so now I've got place.
• 37:19
  What's the other thing I need to code in?
• 37:20
  That's the distance to the ball.
• 37:22
  How close is the ball?
• 37:23
  How close is it getting?
• 37:24
  And so for that, they used frequency.
• 37:27
  They went all the way from 4 hertz to 40 hertz.
• 37:30
  4 hertz means it's very far away.
• 37:32
  40 hertz means it's getting close.
• 37:33
  You need to figure out which way to go.
• 37:38
  And the idea here is we are basically creating a translation between what we experience...
• 37:46
  As a visual input.
• 37:48
  Mm-hmm.
• 37:48
  Where we can do the rate and place just through our visual input.
• 37:53
  That's right.
• 37:54
  Into an electrical input such that... That is...
• 38:00
  regional as a means to create an extra layer of like degree of freedom in in in encoding more data in what is a very relatively flat yes system yeah exactly and we need to be able to give those neurons in my petri dish both of these pieces of information right and one thing i do want to be clear here is the neurons in this petri dish are not directly seeing the game right like we are this is kind of what i'm trying to right yeah
• 38:25
  poke at.
• 38:26
  Yes.
• 38:26
  They're not seeing the game like humans do.
• 38:28
  Instead, they're sort of seeing the game based on the paddle's point of view, in some sense.
• 38:33
  It's like, where am I if I'm the paddle?
• 38:35
  And also, how far away is the ball?
• 38:37
  Right.
• 38:38
  Those are the things.
• 38:39
  And the only...
• 38:41
  The resolution is only like eight pixels in some sense.
• 38:44
  Right?
• 38:45
  But from that, they're trying to make this Petri Dish play Pong.
• 38:50
  Okay?
• 38:50
  So, the other thing that we need to think about...
• 38:54
  It's fine.
• 38:55
  Now we've got a read and write mechanism.
• 38:57
  Yes.
• 38:57
  Now we need a training mechanism.
• 38:59
  Right.
• 39:00
  Right?
• 39:01
  Yeah.
• 39:01
  Because now all of a sudden, I mean, we're telling the Petri dish the state of the game, and we have some way of reading what the Petri dish wants to do, which is move the paddle up or move the paddle down.
• 39:12
  How does the Petri dish know whether it's doing well or not?
• 39:15
  Yes.
• 39:16
  Right?
• 39:17
  The challenge is actually quite non-trivial because in the brain, how do we get a reward for...
• 39:24
  You know, we feel happiness.
• 39:27
  Maybe we got a cookie, literally.
• 39:29
  That is going to fuel dopaminergic neurons in our brain that are going to send signals of dopamine, pleasure, and all this other kind of stuff.
• 39:38
  So we've got like emotional signals for reward.
• 39:40
  We've got other crazy signals for reward.
• 39:42
  This is a brain in a Petri dish.
• 39:44
  It does not have dopaminergic neurons.
• 39:46
  It does not have these centers and this complex brain anatomy to have reward.
• 39:51
  Yes.
• 39:51
  So how are we going to do that?
• 39:54
  And this, I think, is actually the coolest part of the paper to me.
• 39:58
  Okay.
• 39:58
  Okay?
• 39:59
  It's this idea of a closed-loop feedback architecture, and the learning mechanism is literally minimizing surprise.
• 40:08
  Here's what they're doing.
• 40:09
  If there is a successful hit, meaning the Pong...
• 40:14
  paddle thing, hit the ball, okay?
• 40:19
  And we're good to go.
• 40:20
  What it's going to do is all of the electrodes in my multi-electrode array is going to send out a predictable electrical pulse
• 40:32
  It's about 10 volts on every single electrode at 10 hertz, so 10 every second for about 50 milliseconds.
• 40:40
  Very short, very highly structured.
• 40:43
  Okay.
• 40:43
  Okay?
• 40:44
  If, on the other hand, it misses, it's going to get four seconds at 20 volts of highly chaotic electrical activity.
• 40:53
  Mm-hmm.
• 40:54
  And the idea is brains hate that.
• 40:57
  Yes.
• 40:57
  They want to be able to predict the future.
• 41:00
  Yes.
• 41:00
  Okay?
• 41:01
  And when you're giving them highly unpredictable stuff, even this naive network of biological neurons wants to decrease the amount of times it gets that.
• 41:12
  So if we look at the GIF, I just wanted to show one thing.
• 41:15
  So here, we've got the brain coming in.
• 41:17
  You see that bump in electrical activity everywhere?
• 41:20
  And now it's about to miss.
• 41:22
  It's going to miss.
• 41:23
  For four seconds, it's just like there's noise everywhere.
• 41:26
  Yes.
• 41:27
  Okay, we're feeding a bunch of electrical noise.
• 41:29
  The neurons hate that.
• 41:30
  Now...
• 41:32
  The, it's going to go, it's going to actually, oh, I guess it's going to recycle.
• 41:36
  Let's recycle.
• 41:38
  So it'll recycle.
• 41:39
  When it gets there, a bunch of predictable electrical signal.
• 41:43
  That's all we're doing.
• 41:44
  Yes.
• 41:45
  Our reward mechanism is simply, if you got it right, we're going to reward you with a bunch of predictable activity.
• 41:52
  Yep.
• 41:53
  10 hertz, 50 milliseconds.
• 41:55
  And if you get it wrong, four seconds of random chaotic activity.
• 42:00
  Okay.
• 42:01
  And I think this dovetails with some sort of historical science research that's been done around the, you know, when we look at how do we get ordered systems with entropy and this idea of everything goes to soup.
• 42:16
  And the way in which that works is by minimizing surprise.
• 42:21
  Yes.
• 42:21
  This concept.
• 42:22
  It's like a biological.
• 42:23
  It is how life fundamentally is able to instantiate itself.
• 42:27
  Yeah.
• 42:29
  And we're basically hijacking that natural kind of concept by artificially punishing the wrong decision.
• 42:40
  With chaos.
• 42:41
  With chaos, which makes the system work harder.
• 42:44
  And it is naturally going to want to not work harder.
• 42:46
  Yeah.
• 42:47
  And so that's why it chooses the right decision.
• 42:49
  Yeah.
• 42:50
  It doesn't really know that it's the right decision.
• 42:53
  Exactly.
• 42:53
  It's just optimizing for the less possible.
• 42:56
  The more energy efficient pathway.
• 42:58
  Yes, the less surprising.
• 43:00
  The less surprising.
• 43:00
  Sorry, the less surprising.
• 43:01
  Yeah, it's really the less surprising outcome is what it wants, right?
• 43:05
  And now let's look at the results.
• 43:07
  Okay.
• 43:07
  Okay?
• 43:08
  With this training paradigm, let's look at the results.
• 43:10
  The apparent learning is demonstrated in five minutes.
• 43:13
  So here what we're looking at is two sets of box plots.
• 43:17
  The green box plot is what happens from zero to five minutes.
• 43:20
  Okay.
• 43:21
  Okay.
• 43:21
  Um, we're looking at the change in rally length, which is like the, you know, the, how many times the rally happens for, for the pong.
• 43:28
  It's just like in tennis, like how many times do I keep the ball alive?
• 43:31
  Um, and you can see from six to 20 minutes, there's a giant change in the size of the rallies from zero to five.
• 43:39
  So within five minutes, this thing is learning quite well.
• 43:42
  There's a...
• 43:44
  up change in rally and that's for the stimulus for the controls which is silent and no feedback there's no change yeah okay so we're getting a significant change only when they're actually playing the game and they have this feedback yes now if we go to the next photo what we're also seeing is that human cortical neurons
• 44:01
  do a lot better than mouse cortical neurons.
• 44:04
  Yes.
• 44:04
  Okay?
• 44:05
  Yes.
• 44:05
  And that, I don't know, that makes me feel good that my neurons are better than a mouse's neurons.
• 44:09
  We are better.
• 44:10
  Right?
• 44:10
  And that kind of makes sense.
• 44:12
  We've had evolution, and our brains arguably are probably better than mouse.
• 44:17
  And the thing is, there was an improvement in both cases.
• 44:19
  It's just our improvement had a... Had a big... That's a good point.
• 44:22
  Very good.
• 44:23
  Yeah.
• 44:23
  It's that ours had a much bigger improvement than the mice.
• 44:27
  As compared to the mice.
• 44:28
  Right?
• 44:29
  So...
• 44:30
  Now that we have that, let's actually look at this free energy principle that you were alluding to a bit earlier.
• 44:37
  Oh, interesting.
• 44:37
  Okay.
• 44:38
  That's what it's called, the free energy principle.
• 44:40
  This was first pioneered by Carl Fristen.
• 44:44
  And the idea is, what you were saying, all self-organizing biological systems want to minimize something called the free energy, the variational free energy.
• 44:53
  In other sense, what we want to do is maximize the information entropy, and we want to minimize the surprise and the prediction error.
• 45:03
  What we can look at is how much surprise there is for what is the probability of a certain state.
• 45:10
  If the probability of a certain state is very low, there's a lot of surprise, right?
• 45:15
  And you can quantify that in the same way that we actually quantify entropy in physics, which is the log of the probability of stuff.
• 45:24
  And effectively, what the free energy principle is saying is that biological systems...
• 45:29
  want to maintain homeostasis, meaning like constancy over all the random stuff, and we want to minimize that surprise, right?
• 45:39
  And what do we do if we want to do that?
• 45:42
  Well, we've got some internal model of what the world is, and we are going to tune the parameters of that internal model such that that internal model mimics more closely the world that we live in, right?
• 45:55
  That is the idea.
• 45:58
  It's a stark departure, I should say, and highlight, from traditional reinforcement learning.
• 46:04
  Okay.
• 46:04
  Okay?
• 46:05
  In traditional reinforcement learning, you've got some algorithm, and that algorithm explicitly gives...
• 46:13
  negative feedback through backpropagation for wrong trials.
• 46:17
  Here, we are letting chaos itself be the negative feedback.
• 46:22
  Yeah, yeah, yeah.
• 46:22
  Now, one of the things that's kind of crazy is that the algorithms for reinforcement learning require thousands of epochs of trial and error.
• 46:31
  to update these weights through backpropagation.
• 46:33
  Biological systems will inherently self-organize to minimize this free energy, and they'll do it very, very quickly.
• 46:40
  They've just got really nice cellular mechanisms to find that sweet spot in their internal model.
• 46:46
  This goes back to the energy efficiency piece again.
• 46:48
  Yes, exactly, right?
• 46:49
  And so maybe that's why we want to use the...
• 46:52
  Wetware in the first place, right?
• 46:55
  So let's go back to this FEP in a dish, our free energy principle in a dish.
• 47:00
  Effectively, what's happening is you've got predictions and then you've got prediction errors.
• 47:05
  The predictions are where I want to move my...
• 47:09
  Paddle.
• 47:10
  And the prediction error is the chaos that I get when I get it wrong.
• 47:16
  Right?
• 47:17
  I'm trying to change the connections in my neurons on my Petri dish such that I minimize prediction error.
• 47:26
  And that's effectively what these neurons are doing.
• 47:29
  It's actually pretty incredible when you think about it.
• 47:31
  We're not giving them a bad and good signal.
• 47:35
  We're only giving them...
• 47:38
  chaos versus non-chaos signal.
• 47:41
  Right, right.
• 47:42
  And that itself, just because of the nature of information and the physics of information...
• 47:48
  is enough to like steer them like this is bad and that's good i think that's like quite deep the universe the universe never chooses violence yeah yeah it always chooses to billy when given i i'm being a little facetious no but i think i think i think that's a very good that's a very poignant statement here so now let's look at like some of the hype that they created around it okay let's look at some of the promo videos and this was for the pong
• 48:13
  This is just 2022.
• 48:14
  We're still on 2022.
• 48:15
  Okay, just confirm it.
• 48:17
  Because I know people are listening, waiting for the Doom.
• 48:19
  Yeah, but we need to really understand this in order to get to Doom.
• 48:22
  100%.
• 48:22
  Okay, so this is one of their...
• 48:26
  Promo videos.
• 48:27
  Look at how many.
• 48:28
  This is doing really well.
• 48:30
  It's already at like rallies of three.
• 48:31
  Yeah.
• 48:32
  Maybe it'll get to four.
• 48:33
  Yeah.
• 48:34
  Yep.
• 48:34
  Yep.
• 48:34
  Is it going to get to four?
• 48:36
  Yeah.
• 48:36
  It got to four.
• 48:37
  Four rallies, right?
• 48:38
  Like this is, it's really, it's really doing it.
• 48:41
  Five.
• 48:42
  It was getting to five.
• 48:43
  Yes.
• 48:43
  Now let's look at the results from their paper.
• 48:45
  Okay.
• 48:46
  Okay.
• 48:46
  Okay.
• 48:46
  From the results from their paper, if we look at the left-hand side.
• 48:49
  Yes.
• 48:49
  Yes.
• 48:50
  So figure B, that's the average rally length.
• 48:54
  And look at the y-axis.
• 48:56
  What is the y-axis on?
• 48:58
  It's on 1, right?
• 49:00
  Most of their trials are on 1.
• 49:03
  Even on their box plot, the edge of their trials for human cortical neurons, which is the right-hand side box plot, is going to 1.5.
• 49:09
  Mm-hmm.
• 49:11
  Right.
• 49:11
  Which is that's the I think it's the third quartile usually for box plots.
• 49:17
  So it's like the 75 percent of data falls within one point five.
• 49:20
  So clearly they're like showing a very nice example in their video.
• 49:25
  Right.
• 49:26
  It's still statistically significant.
• 49:28
  If you look at the human cortical neurons, which is the right box plot in figure B.
• 49:33
  Yes.
• 49:33
  Yes.
• 49:34
  From zero to five minutes, the average rally length is at 0.5, and now it's bumped all the way to one.
• 49:41
  And if you look at the spread of that data, clearly it's highly significant.
• 49:45
  If you look at all the other metrics, you can see for human cortical neurons, they do the best compared to mouse cortical neurons and all the other controls.
• 49:52
  So there's clearly an effect, but the Cortical Labs team are a startup.
• 49:56
  Yes.
• 49:56
  And so, you know...
• 49:58
  as is tradition in startups, not just in Silicon Valley, but around the world, even in Australia, they're going to hype up some of the results.
• 50:06
  And that's fine.
• 50:07
  I still think it's a very cool...
• 50:09
  thing that they did.
• 50:10
  Yes, and we just walked through why it's incredibly cool.
• 50:13
  Yeah.
• 50:14
  And if you think that AI is using too much energy, you should be all for wetware.
• 50:18
  Yeah, yeah.
• 50:19
  I mean, it maybe has a lot of applications.
• 50:22
  So now we're going to scale this up.
• 50:24
  Okay.
• 50:25
  We're going to scale it up to complexity level 1000 because we are now trying to play Doom.
• 50:32
  They built the CL1 platform.
• 50:34
  Cortical Labs first first
• 50:37
  code deployable biological computer in the world.
• 50:41
  I love that.
• 50:41
  That's what it looks like.
• 50:42
  It's a little box that at its center has the Petri dish with all of the biological fluids and all the things to keep the neurons active.
• 50:53
  You've got the multi-electrode array.
• 50:55
  Yeah.
• 50:55
  And you've got a little screen on the side that shows you the health of the neurons, the amount of oxygen there is, the amount of CO2 there is, and so on and so forth.
• 51:03
  So it can regulate temperature.
• 51:04
  It can manage gas exchange.
• 51:06
  It can clear metabolic waste because these neurons are alive, so they're going to be creating waste.
• 51:11
  All of this other stuff, and they can actually...
• 51:13
  survive in that in vitro Petri dish for up to six months.
• 51:16
  That's a very long time.
• 51:17
  Yeah.
• 51:18
  Okay.
• 51:18
  For a sort of little mini organoid to survive.
• 51:22
  So how about the software?
• 51:24
  This is very cool.
• 51:25
  So for the, for the pong, for the pong, for the pong,
• 51:29
  story.
• 51:30
  They had a custom built C, C++ machine language type thing.
• 51:35
  Nobody wants to code in C++.
• 51:37
  I get that you want the base layer of your software to be in C++ because we want very low latency.
• 51:44
  Yes.
• 51:45
  Right?
• 51:45
  And C is an extremely fast language.
• 51:47
  Python is quite slow.
• 51:48
  But at the high level, I want to code in Python.
• 51:50
  Yeah.
• 51:51
  And then maybe the Python gets transferred into C. And what they did was they created something called a cortical cloud and a Python API.
• 51:58
  So now you don't need C++.
• 52:00
  And you've got a cloud computer of a bunch of CL1 platforms that are each little tiny...
• 52:12
  brains on a dish that I can now just like get into my, you know, on my laptop, I can access.
• 52:18
  It's open platform.
• 52:20
  I mean, you have to like apply and say like, this is what I want to do with it.
• 52:23
  But this is, I think, very clever from Cortical Labs because even IBM, like one of the reasons why
• 52:29
  Kiskit, which is the quantum computing platform for IBM, like their software platform, that's used a lot because they've created a cloud platform where theorists and like people who want to do testing of quantum algorithms and things like that, they can go into Kiskit, they can apply for time.
• 52:46
  on the IBM quantum computer.
• 52:47
  They've got like a dilution refrigerator with that IBM quantum computer.
• 52:51
  And they can like test out their algorithms and like their error correction methodologies and things like that.
• 52:56
  So democratizing it is a really good way for like a startup or like a small computer lab to be like, hey,
• 53:02
  We've created the hardware.
• 53:04
  Why don't you guys go at it?
• 53:05
  Yes.
• 53:05
  Right?
• 53:05
  Yes.
• 53:06
  It's very Matrix-esque.
• 53:08
  If you remember the scene where Neo unplugs and he sees all the pods of humans to capture heat for the machines, that's what that effectively wetware server rack, AWS NVIDIA server rack.
• 53:20
  Exactly.
• 53:20
  Yeah, it's like AWS, but for like wetware.
• 53:24
  It's pretty crazy.
• 53:26
  And AWS for a brain on a chip.
• 53:28
  That is so outrageous.
• 53:30
  Amazon Web Services, for those who don't know, is the infrastructure layer that provides the back end for a large amount of all of the software applications that you use every day.
• 53:40
  Yeah, exactly.
• 53:41
  So with that in mind, now that we've got a cloud computing platform, now independent researchers and developers can mess around with it.
• 53:48
  And this is where we get into Sean Cole.
• 53:51
  He's an independent developer who wanted to use the CL1 platform
• 53:57
  to play Doom Freedom.
• 53:59
  Classic.
• 53:59
  Okay?
• 54:00
  And the... You know, one of the...
• 54:02
  I don't know why this is a meme, but, like, whenever you have, like, a new piece of computation or something, everyone's like, can it play Doom?
• 54:08
  Can it play Doom?
• 54:09
  100%.
• 54:09
  Right?
• 54:10
  Like, even the ESA has, like...
• 54:12
  Made satellites play Doom and things like that.
• 54:16
  So I guess it's a meme.
• 54:18
  And the guys at Cortical Labs knew this was a meme.
• 54:22
  Yes.
• 54:23
  And knew that if they could make their little thing play Doom, it would get a lot of hype.
• 54:28
  And it certainly worked.
• 54:30
  And I just want to give a shout out to John Carmack, who was the inventor of Doom at id Software and literally was one of the pioneers that created all the video game.
• 54:40
  Like that was like the 3D platform, like that concept and what they did at the time is what created all first person shooter style or like all these types of games.
• 54:51
  So is Doom before?
• 54:53
  What's the James Bond?
• 54:55
  James Bond Goldeneye.
• 54:55
  Yeah.
• 54:56
  Yeah.
• 54:57
  I don't have a chronological knowledge.
• 55:00
  But I feel like James Bond GoldenEye was also kind of... Like, from what I've...
• 55:04
  I've never played Doom, but I've seen the videos while I was researching this.
• 55:08
  And it looked kind of like...
• 55:09
  It's similar.
• 55:10
  Yeah.
• 55:11
  But it's not Doom.
• 55:11
  Yeah, it's not Doom, I guess.
• 55:13
  I was a 64 guy.
• 55:14
  I played GoldenEye all the time.
• 55:15
  Yeah.
• 55:16
  And I loved the music.
• 55:17
  But Doom is sort of... Doom is kind of like this OG...
• 55:19
  It's its own thing.
• 55:20
  Yeah.
• 55:20
  So...
• 55:21
  It is way more complex than Pong.
• 55:23
  So, you know, one of the things that I, as I was like researching Doom and I was like watching some videos of people playing Doom, you know, it's really, you're transitioning from a 2D linear game like Pong to now it's kind of like this 2.5 dimensional.
• 55:37
  I wouldn't really say three dimensional because it's like first person and like,
• 55:43
  It's not really fully three-dimensional, I would say, but there's still...
• 55:46
  It involves complex navigation, threat detection, and all of this other very cool stuff.
• 55:51
  So it's a way harder problem than... Up, down, down.
• 55:56
  how close yes exactly right oh you're already getting there is like those are the sort of salient things that i need to code in you know before in pong i needed to code in position of my paddle and where the ball is here in this case i need to figure out where what direction the enemy is and how close they are anyways let's get to um the stem the cells we got 200 000 human
• 56:19
  Pluriports and stem cells.
• 56:21
  Yes.
• 56:21
  So this is a fourth of what we had in Pong.
• 56:24
  Oh, yeah.
• 56:24
  This is fewer than what we have in Pong.
• 56:26
  Yeah, exactly.
• 56:26
  Right?
• 56:26
  Okay, yep.
• 56:27
  But because of, like, the cloud computing nature and the fact that this is all in Python, the guys were able to map the engine to the tissue in just a week.
• 56:39
  And this is what it looks like.
• 56:40
  Jesus.
• 56:41
  So you've got your chip, and it's sensing motor neurons, or it's sensing the neurons, and then it's playing Doom.
• 56:48
  This is crazy.
• 56:49
  Right?
• 56:50
  Yeah, yeah, yeah.
• 56:51
  It's pretty cool.
• 56:51
  Yeah, and we're seeing this, like, the real neural activity.
• 56:55
  Yeah, those are the neurons that are coming in, and then the Petri dish is sort of controlling which way to point and which way to fire, right?
• 57:04
  So let's get into how actually they did it.
• 57:06
  Because in Pong, remember, we've got a sensory cortex, we've got a motor cortex.
• 57:10
  They're going to do very similar things.
• 57:13
  In this case, the...
• 57:17
  Proximity.
• 57:18
  We want to encode information about the game state, right?
• 57:21
  So there's proximity, which is how close I am.
• 57:27
  Yes.
• 57:28
  And there's direction, which is where I'm trying to fire.
• 57:32
  They're using place and rate to code that, right?
• 57:36
  Now, we want to take the damage.
• 57:38
  So taking damage and dying is going to be the chaos.
• 57:42
  And if we shoot someone, that's going to be the predictive.
• 57:45
  Ah.
• 57:46
  Ah...
• 57:46
  Reward.
• 57:47
  Okay, interesting.
• 57:47
  Because I was wondering how I was going to map from Pong to Doom.
• 57:50
  Yeah.
• 57:51
  And that's how you do it.
• 57:51
  And for the motor neurons, there's specific firing patterns that are going to be moved forward.
• 57:57
  There's specific firing patterns that are going to be turned.
• 58:00
  And there's specific firing patterns for fire a weapon.
• 58:03
  And the performance, after seven days of training, the agent's kill ratio was roughly twice that of pure chance.
• 58:09
  Now, I don't know what that means.
• 58:11
  And this is where it gets kind of annoying because there's no paper.
• 58:14
  Yeah.
• 58:14
  Right.
• 58:15
  So there's no methods.
• 58:16
  They just kind of said that.
• 58:17
  Right.
• 58:17
  I'm like, I don't I don't really know what that means.
• 58:20
  Yep.
• 58:20
  But they're explicitly admitting that the cells played like a beginner who's never seen a computer.
• 58:26
  So it's not very good.
• 58:27
  Yeah.
• 58:27
  Right.
• 58:28
  But it's still, I guess, higher than chance.
• 58:30
  Yes.
• 58:30
  So maybe that's something.
• 58:32
  One of the things that I found kind of interesting was that during the study, the agents actually generally settled settled.
• 58:39
  for a strategy of survival, which is hiding rather than active combat.
• 58:43
  And this is something that is well known in reinforcement learning, right?
• 58:47
  You just like go for the local minima, which is I don't want to deal with anything.
• 58:51
  I don't want any reward whatsoever, even the positive or the negative, because that positive or negative reward comes from a dense like chain of brittle action, right?
• 59:00
  I have to do stuff.
• 59:01
  I have to do stuff.
• 59:02
  And at the very end, I might just get chaos and then it might just be bad.
• 59:06
  So why don't I just like go to a corner and try to hide?
• 59:09
  I wish they gave the nuke testing AI paper people the same wetware to go to the local minimum.
• 59:17
  Because as we talked in our two episodes ago, all the major model companies, Anthropic, Gemini, OpenAI, all used nukes 90% of the time.
• 59:27
  Yeah.
• 59:27
  Which does not sound like what you're talking about.
• 59:29
  Yeah.
• 59:29
  Yeah.
• 59:29
  No.
• 59:29
  This one is just, they just want to.
• 59:31
  They're like, we're just trying to hide.
• 59:32
  Yeah.
• 59:32
  I'm just going to try and hide.
• 59:34
  So.
• 59:35
  Now we've covered what Cortical Labs is purporting they did in their YouTube video.
• 59:40
  This is where I got a lot of that information.
• 59:42
  Yes.
• 59:43
  Now let's ask what's actually going on.
• 59:45
  Yeah, yeah.
• 59:46
  Okay, because there's a lot less info about the Doom game versus the Pong game.
• 59:51
  The Pong game had a full-ass...
• 59:54
  You know, peer-reviewed paper in Neuron.
• 59:56
  This one does not.
• 59:57
  This one is just, like, blogs is all I got.
• 1:00:00
  Okay?
• 1:00:01
  Here's my concern.
• 1:00:02
  And this is something that I actually read Tommy Blanchard's sub stack on.
• 1:00:09
  So if you guys want to check out his sub stack, he's got a lot more info on it.
• 1:00:13
  Here's the concern.
• 1:00:14
  There are eight input channels for Pong, right?
• 1:00:17
  But Pong is a very small game.
• 1:00:19
  I can reasonably...
• 1:00:21
  Put all of that information into eight electrodes.
• 1:00:24
  How do I encode everything that's going on in Doom with only eight inputs?
• 1:00:28
  Yeah.
• 1:00:29
  Each of which can only have a few possible values, like either the electrode is on or off.
• 1:00:33
  And the answer is you actually don't.
• 1:00:35
  You use a reinforcement learning model.
• 1:00:38
  This is where it gets a little bit fishy.
• 1:00:40
  Okay.
• 1:00:40
  Okay?
• 1:00:40
  Okay.
• 1:00:41
  Here, this is from their Doom Neuron.
• 1:00:45
  Like, they've got a little, it's kind of like a GitHub where they have a documentation on what they did.
• 1:00:51
  This is the architecture of what they're showing is they've got a computation unit, and that is talking to their CL1 computer.
• 1:00:58
  Yeah, yeah.
• 1:00:58
  Okay?
• 1:00:59
  In that computational unit, on the left, right-hand side, what you can see is there is a PPO policy.
• 1:01:04
  Yeah, yeah.
• 1:01:04
  Which is a reinforcement learning paradigm.
• 1:01:07
  Yeah, yeah.
• 1:01:08
  That is then encoding the input of the game.
• 1:01:12
  That is then going as stimulation to the brain, to my brain in a Petri dish.
• 1:01:16
  And what I get back is action.
• 1:01:18
  And that is getting fed back into my reinforcement learning algorithm.
• 1:01:21
  So now I can very easily ask who is actually doing the learning?
• 1:01:25
  Correct.
• 1:01:26
  Is it my reinforcement learning algorithm?
• 1:01:28
  Or is it the actual biological neurons that I have?
• 1:01:31
  It doesn't count.
• 1:01:32
  It shouldn't really count.
• 1:01:34
  It's not pure.
• 1:01:35
  And it's not that far away.
• 1:01:36
  Like reinforcement learning, there's video games that have perfected reinforcement learning.
• 1:01:41
  Dota 2, OpenAI defeats Dota 2 world champions.
• 1:01:45
  So that's not that big of a deal.
• 1:01:46
  Correct.
• 1:01:47
  So the question is, was the software decoder, which is that translation layer, was that actually in...
• 1:01:55
  The learning algorithm?
• 1:01:56
  Or is the actual neuron doing something?
• 1:01:58
  Because in the Pong case that we already talked about earlier in the episode.
• 1:02:02
  Very direct.
• 1:02:03
  It was direct, and it was maybe incremental, but it was demonstrable learning.
• 1:02:07
  Yes.
• 1:02:07
  And we could very visibly say the neurons are doing the computation.
• 1:02:12
  The neurons are doing the computation.
• 1:02:13
  The neurons are doing the learning because there's no funny business going on where, like, I've got a reinforcement learning agent.
• 1:02:19
  Okay, fine.
• 1:02:20
  So now it's playing a video game.
• 1:02:21
  What's the big deal?
• 1:02:22
  It knows all the history of Doom's lore internally.
• 1:02:25
  So here's how they address that.
• 1:02:27
  They actually did address it in their...
• 1:02:30
  frequently asked questions section.
• 1:02:32
  They said, okay, isn't the decoder doing all of the learning?
• 1:02:37
  What they tested it was, how they tested it was through an ablation study.
• 1:02:41
  So they've got a metric called a breakthrough rate, which is the amount of episodes that scores above a negative 600 reward threshold.
• 1:02:48
  Now negative 600 is pretty low because negative 1000 is the floor.
• 1:02:52
  I've never played Doom, so maybe somebody can tell me if negative 600 is like a lot or a little.
• 1:02:57
  But here's the key metric that they said.
• 1:02:59
  Yeah.
• 1:03:00
  They said that if I were to use the neurons in the loop, I get 27% breakthrough rate.
• 1:03:06
  So my score is above that negative 600.
• 1:03:09
  If it's complete silence, so no input from the neurons, or if I put random noise from the neurons, then I get only a 7% to 8% breakthrough.
• 1:03:17
  So the neurons are doing something.
• 1:03:19
  Yes.
• 1:03:19
  Again...
• 1:03:20
  There's not a lot of trials.
• 1:03:22
  They're just spitting out these numbers.
• 1:03:24
  It's not, you know, I don't see data.
• 1:03:26
  I'm just like taking their word for it that they wrote in a blog post that it's 27% rather than 8%.
• 1:03:32
  So from baseline, okay, fine.
• 1:03:34
  Baseline is 8%, 27%.
• 1:03:36
  Maybe I'll take your word for it.
• 1:03:37
  The next problem that they addressed in their frequently asked questions is that there's a, you know, is it the encoder?
• 1:03:46
  Is it the thing that is encoding the neuron state and then feeding it into the reinforcement learning thing?
• 1:03:53
  Because that itself is a neural network.
• 1:03:55
  So is that doing all the learning?
• 1:03:56
  Well, let's see.
• 1:03:57
  So if you look at Photo30, this is their response.
• 1:04:00
  They say that, you know, well...
• 1:04:04
  The brain cells in the loop, they're effectively saying that assuming the brain cells are static, this is not correct.
• 1:04:10
  The policy in the cells are dynamical systems, so the biological neurons have an internal state, and that is affecting the reinforcement learning.
• 1:04:17
  Now, to me, all that's saying is like, well, we actually made it harder for the reinforcement learning agent.
• 1:04:24
  Yeah.
• 1:04:25
  You know, it's like, okay, the neurons are kind of like a noisy controller that I'm, like, using to create action in my game.
• 1:04:33
  And maybe, you know, to me it's like, okay, well, that just means my reinforcement learning agent is, like, okay with a noisy controller.
• 1:04:41
  Right.
• 1:04:41
  The last sentence is what is key.
• 1:04:44
  During testing, encoder weights were frozen and still observed improvements in reward, which means that I...
• 1:04:50
  I froze the way that I am reading my neurons, and still there was improvement, which means that the neurons were maybe doing some type of learning.
• 1:05:00
  But there's still the encoder in between, even if it's in a frozen state.
• 1:05:04
  And so how do you know that it's not attributed to some base capability in the encoder, even if it's frozen?
• 1:05:11
  Yes.
• 1:05:11
  So that's where I'm like...
• 1:05:13
  I mean, that's my naive take.
• 1:05:14
  That's exactly right, right?
• 1:05:16
  It's like in the YouTube video, they talk about, oh, it's like...
• 1:05:20
  You know, if the neurons fire a certain way, the game is going to turn left.
• 1:05:26
  If the neurons fire a certain way, the character in the game will move forward.
• 1:05:31
  And if they want to fire, the neurons will fire a certain way.
• 1:05:33
  Well, not really.
• 1:05:35
  If the neurons fire one way or the other, it might just be that the reinforcement learning agent is just also interpreting the state of the game and just overriding everything.
• 1:05:44
  So I don't think it's a very clean test.
• 1:05:47
  Is what I'll be honest about, right?
• 1:05:49
  And perhaps they're working on a paper that is going to elucidate some of these holes.
• 1:05:54
  I certainly hope so because I do want a Petri dish game.
• 1:05:59
  Right.
• 1:06:00
  Sorry.
• 1:06:00
  I do want a Petri dish game.
• 1:06:03
  brain to play doom i think that would be hella cool yes but i'm i'm i think i think the jury is still out because one all of this is anecdotal yes so there's no hard data they're not showing actual you know box plots about the spread and so on and so forth there was another thing that i read just briefly that was saying that the the the seed
• 1:06:23
  in my neural network actually affects how the gameplay is done, right?
• 1:06:27
  The random seed that initializes weights and things like that.
• 1:06:30
  It's like, well, if it's that fragile, can you really say something about whether the neurons are doing anything?
• 1:06:35
  So I don't know, you know?
• 1:06:37
  But that's my skepticism.
• 1:06:38
  And this is not to take away from the foundational discovery that DishBrain, in the Pong context, which is why we took the time to talk about how we got to the Doom version, which is like there is a there there.
• 1:06:52
  Yes.
• 1:06:52
  Yes.
• 1:06:53
  But the way in which they're trying to scale it up for the increased complexity of the tasks they're trying to get the wetware to do, it is not clear that it is purely from improvements at the artificial...
• 1:07:08
  human pluripotent stem cell level that's doing the learning.
• 1:07:13
  Exactly.
• 1:07:14
  It could just be the infrastructure that has now been built around it.
• 1:07:17
  Exactly.
• 1:07:17
  That makes it kind of like an interesting thing.
• 1:07:20
  Exactly.
• 1:07:20
  But not brains on a chip are doing all of the heavy lifting.
• 1:07:24
  Exactly.
• 1:07:24
  And that's what all of the...
• 1:07:27
  That's what all of the news articles are saying, right?
• 1:07:29
  All of the news articles are like, brain in a Petri dish, play Doom.
• 1:07:34
  I don't think anyone's mentioned this reinforcement learning paradigm in the middle.
• 1:07:38
  Right.
• 1:07:38
  That is kind of the whole game, maybe.
• 1:07:40
  Right.
• 1:07:41
  And because there's not a paper, again, like the Pong version, which they've previously done, the jury is going to still be out on this.
• 1:07:47
  And that's why it's really important to have peer-reviewed journals, because a reviewer would be like, what?
• 1:07:52
  You know, what are you doing?
• 1:07:53
  We're doing that here on the pod, let alone in the professional politics.
• 1:07:56
  Yeah, exactly.
• 1:07:56
  Yeah.
• 1:07:57
  One last thing I want to touch on is there was a lot of heat that the authors took for their 2022 paper because the 2022 paper in their title mentioned sentience.
• 1:08:10
  Learn and exhibit sentience.
• 1:08:12
  There was another paper that came out.
• 1:08:14
  Yeah.
• 1:08:15
  That was a backlash.
• 1:08:17
  Okay.
• 1:08:18
  Again, published in Neuron as a rebuttal.
• 1:08:20
  And they were effectively saying that you can't use sentience, right?
• 1:08:23
  Or the idea of perceiving.
• 1:08:26
  Because the behavior that you're mentioning and you're observing here when the Petri dish plays Pong is one of homeostatic feedback stabilization.
• 1:08:35
  There's no high-level cognitive intent.
• 1:08:38
  Yeah, yeah, yeah.
• 1:08:39
  And so you can't really say things like that, because then with sentience comes ethical concerns.
• 1:08:45
  In the public lexicon, the term sentience means...
• 1:08:49
  There's some morality now that we have established onto this dish.
• 1:08:55
  And if that's the case, well, what are we actually doing?
• 1:08:58
  Yes.
• 1:08:58
  Yeah.
• 1:08:59
  And I think we kind of, over the course of this episode, we've kind of landed on that same point, which is, oh, this is an interesting fundamental understanding of how you can control neural networks through electrical, like electrical read and write architecture.
• 1:09:17
  Yeah.
• 1:09:17
  to optimize for stability in the system.
• 1:09:21
  That's cool, but that's effectively what it's... And then we're just connecting that to an external thing we are interpreting and giving value to as like, oh, hit it with the paddle.
• 1:09:31
  Yeah, yeah.
• 1:09:31
  But it...
• 1:09:33
  fundamentally yeah fundamentally it's just trying to reduce surprise but surprise itself is a mathematical construct that is trying to reduce right just because of the way that the proteins and the right and the neurons work when they when they get together right so it's it's a far leap to say this dish brain is sentient because it can sense and respond to an environment like pong right right
• 1:09:55
  But this, again, I don't know.
• 1:09:58
  This is, again, this is, we're going beyond my pay grade, and I do want to be very clear about that, right?
• 1:10:03
  Because questions of consciousness, questions of sentience is something that I grapple with all the time.
• 1:10:08
  I...
• 1:10:10
  have a PhD in like neural systems, right?
• 1:10:13
  Like one of my PhDs was about how neural networks talk to one another and sleep and so on and so forth.
• 1:10:18
  You can create very simple neural systems that sleep and mimic behavior.
• 1:10:22
  I don't know what consciousness is, but for them to put that in the title is, is a bit weird.
• 1:10:27
  Yeah.
• 1:10:28
  And I think that's what the rebuttal was about.
• 1:10:31
  Which I think is fair pushback.
• 1:10:33
  Not to minimize the work being done and just to be clear.
• 1:10:37
  This is not trying to be like, oh, you didn't do anything.
• 1:10:40
  Sometimes the reviewers... No, because it's pretty cool.
• 1:10:41
  Sometimes the reviewers are like, yeah, you didn't do anything.
• 1:10:43
  Oh, yeah.
• 1:10:43
  That's not what we're saying.
• 1:10:44
  It's just that there's a nuance about the really cool thing that is being done.
• 1:10:50
  And then the CNN news headline that says, brain on a chip is playing Doom.
• 1:10:54
  Yeah.
• 1:10:55
  Which is not... Yeah.
• 1:10:56
  Yeah.
• 1:10:57
  quite accurate.
• 1:10:59
  Yeah, exactly.
• 1:10:59
  And so, you know, and on this podcast, we're in the business of like just talking about what was done.
• 1:11:04
  Yes.
• 1:11:04
  What were the methods and what were the actual findings and the results?
• 1:11:09
  And so, you know, it is what it is.
• 1:11:11
  They use the reinforcement learning paradigm.
• 1:11:13
  I don't know if that changes things.
• 1:11:15
  It seems to me that they have a lot more work to do to convince someone like me that it's the neurons that are playing doom and not some small artificial neural network.
• 1:11:25
  right there's not a lot of details so i'm looking forward to hopefully a peer-reviewed scientific paper you know cortical labs if you want us to come over to melbourne i think it's melbourne yeah it's melbourne uh come in and do some coverage as you prepare for release of a research paper we are more than happy to join you oh yeah and have the opportunity to learn more uh if you we will send this episode to you to get your feedback as well or corrections so
• 1:11:50
  Please let us know if there's anything that we can do to clarify here.
• 1:11:53
  We are fit.
• 1:11:54
  Like this is super interesting.
• 1:11:56
  Yeah.
• 1:11:56
  We are just curious to learn more.
• 1:11:58
  And so I'm sure they are already well ahead of us.
• 1:12:00
  Yeah.
• 1:12:01
  On that point.
• 1:12:02
  So we'll see what happens.
• 1:12:02
  We will cover if there's a follow up.
• 1:12:04
  We will cover it again.
• 1:12:06
  This was a phenomenal episode around some of these details.
• 1:12:11
  We could talk about this forever.
• 1:12:12
  However, we said we were going to keep our episodes shorter, so I'm going to quickly wrap us up here.
• 1:12:19
  After that, let us know in the comments.
• 1:12:21
  We have a comment for the community today, for folks to comment on.
• 1:12:26
  What game do you want to see?
• 1:12:28
  Oh, that's a good one.
• 1:12:29
  What game would you like to see the brain on a chip play next?
• 1:12:32
  Doom was number one.
• 1:12:33
  What's number two?
• 1:12:34
  I know what my thought is.
• 1:12:35
  Maybe we'll share it next episode.
• 1:12:37
  Yeah.
• 1:12:37
  I'm your host, Lester Nari, joined as always by my co-host and our resident PhD, Krishna Chowdhury.
• 1:12:44
  Again, multiple episodes a week.
• 1:12:45
  We'll see you later this week.