Latest / The Vance Crowe Podcast / Joscha Bach on AI, Religious War, and Cyber Animism
Transcript
- 0:07Unknown: Welcome to the podcast. I'm your host, Vance Crowe. Today is one of the best days of the year or every other year that I get to talk with
- 0:15one of I think is not just a national treasure, but maybe an international treasure, Yosha Bach on the way the mind works about AI and all kinds of crazy things. So Yosha,
- 0:25welcome to the podcast.
- 0:27Unknown: Thank you.
- 0:28Unknown: So, I want to start off because when I talk with people about AI, I'm really enthusiastic about it, but I can detect a lot of fear in people. Young people that are thinking about their jobs in the future, people my age that are worried about what their children are gonna grow up in.
- 0:43How should people think about this thing that seems now inevitable to me?
- 0:48Unknown: So first of all, it's very difficult because we don't know. It has never happened before.
- 0:53But what we know from the past is that all the technological revolutions created more and better jobs.
- 0:59Maybe this time is the first time it's different, but we don't know.
- 1:04But you can already observe is that AI at the moment is creating more jobs than it removes. So, basically, companies are removing a lot of jobs because they can be automated, but at the same time, they are hiring more people because they become more productive.
- 1:19And
- 1:19that's a development that is happening quite rapidly. I would have expected that there is a longer delay between
- 1:27rules being made obsolete and new rules being created. But at the moment, there is pros due to AI. We also shouldn't forget that this out AI would we would be in a recession. Our economy would be shrinking. The thing that is mostly driving all the development right now that we have in our economy is artificial intelligence.
- 1:44So why do we have this fear?
- 1:47And I suspect that the fear has one major reason, and that's the reaction of the news media.
- 1:53Because I think that they are still reeling from the effect that the whole computerization
- 1:58in the Internet had on the news media because the Internet had been killing the ad business of the news and also the core business model of the news because you get news for free everywhere. Right? So the main thing that news are now doing is that they tell you not what to know, but how to think, what your neighbors are thinking, what your in group is thinking,
- 2:18and they don't want to give this app. They are basically worried that AI might infringe on their business model. I think that's a large factor.
- 2:26And so what we've seen in the past few years is that a lot of media starting from the New York Times downwards have decided that they cannot make positive
- 2:35press about
- 2:36tech developments.
- 2:38And so they have been rather critical.
- 2:40And
- 2:41I I think that when you look at the facts on the ground, there is, I think, reason for concern because it's simply it's a very grave change that is happening due to AI.
- 2:49It's happening a lot slower, I suspect, than the people in the AI industry expect
- 2:53because there is a lot of inertia.
- 2:56It takes time to change existing businesses, to develop new revenue streams, to develop new business models, and for society to adapt. So a lot of these things are going to happen. There's a lot of friction. And when you are outside
- 3:08of the big cities,
- 3:10outside especially of the Bay Area,
- 3:13a lot of people are not using agents. A lot of people are not playing with all the things that we are playing with.
- 3:19And so AI is is very uneven in the way in which is distributed. On the other hand, I think the change is going to be very substantial and go is going to go deeper
- 3:30than people can imagine. But the same thing is also true for the the previous technological revolutions.
- 3:36When the Internet was happening,
- 3:37a lot of people didn't think that it would be a very significant development,
- 3:41and relatively few people anticipated
- 3:43that it would permeate our life as thoroughly as it has done. Same for mobile and so on. So all these things are already happening at the depths that our grandparents
- 3:54would have had difficulty to anticipate and imagine how ubiquitous it becomes, how normal it becomes. And so AI is also going to be normal at some point. And at the moment, it's very far from normal because it's still happening so rapidly and can do so many things that are different from what we expect.
- 4:12So things that we got used to, for instance, how media is presented in the Internet, that everything is available to our at our fingertips was something that we did not imagine that would be happening, that we could basically watch every movie that has been ever made somehow or find all the music, find all the ideas, and so on, and wherever we are, that's a new thing. But what's now happening is that there is gradually more generated media than real media,
- 4:36and that's also a very great change, and we don't yet know how to deal with this. Right? We probably need to watermark human content soon.
- 4:43But one thing that's very important that I think that people are not actually looking at enough is that AI is much more benign
- 4:52and equitable than I would have expected and anybody had the right to think. And who would have thought that it would cost
- 5:00many millions of dollars to train leading model, but everybody would be able to use it for $20 a month.
- 5:07It is general
- 5:08ubiquitous access to artificial intelligence with something that nobody had in their cards. Another thing that's happening is that
- 5:16many of the large companies have decided to release open source versions of the models. Like, the LAMA models of Meta were one of the big starts, but there are many others that you can download and that you can fine tune at a reasonable cost, which means that academia and hobbyists and the open source community
- 5:34can also play in the same game.
- 5:37And there is not a very big moat that a large AI companies have around their models. All this might change at some point, but at this point, it's still very equitable.
- 5:46And another thing is that everybody is trying to make their models as safe as they can. There is a very genuine interest by the AI companies to build models that The New York Times could be happy,
- 5:57and The New York Times will never be happy. Instead, they are fear mongering. And this fear mongering,
- 6:02I think, probably harmful to us as society because it's not going to stop AI. It's not going to delay AI, but it's going to make it harder for us to adopt the technologies and to
- 6:13make use of them and to shape them into the thing that we need them to become to be helpful to us.
- 6:21Unknown: You know, I've I've been given talks where I've mentioned a talk that I saw you give years ago, and you were an AI researcher. And I remember I used to have to tell people what that was because AI seemed like something that was, fake, you know, never would come to be. Is the AI of today what you dreamed it would become
- 6:40ten years ago, fifteen years ago when you were imagining this? No. It's quite different.
- 6:45Unknown: In the nineties, I was in a department in New Zealand.
- 6:49And in this department, we did data compression.
- 6:52And I found it a very interesting topic, and the professor who was championing this research, Ian Bitten, is one of the leading researchers in data compression. And what put him in there was this idea that data compression
- 7:06is
- 7:08maybe the key to understanding cognition.
- 7:11And the reason why he thought that is because in order to
- 7:15compress text,
- 7:16you need to be able to predict the text, and then you need to only to encode the difference to what you can predict.
- 7:23So by making a predictive model that learns the statistics of text, you are able to make a model that is able to predict what text comes next. And to do this, you need to have something that is closer and closer to human cognition,
- 7:36the better you can predict it.
- 7:38And myself,
- 7:39I, during the time, developed a program that was
- 7:44trying to find grammar in an unknown language.
- 7:47And the unknown language I used was English because it was unknown to the computer, but I also tried it with Chinese and French, and the same learning algorithm did the same things. And it was a model to basically did statistics over text.
- 8:01And it did so not just by adjacent words, but by finding, basically, some kind of graphical hierarchical structure over the sentences that would predict the structure of the text best. And that structure coincided also with the semantic structure of the text. And back then, I used the largest computer that we had at the department. It had two gigabytes of RAM. It was completely mind blowing, and I did in memory compression to be able to process as much as I could.
- 8:25And after running for a few days, that thing was able to find grammatical structure. I thought if I can have much more memory and much more compute, I can also find semantic structure.
- 8:36But I later on dropped this topic and didn't revisit it because,
- 8:41ultimately, it was boring. Right? You can see that there is some correlation between the semantic structure and the statistics, and, ultimately, that might be the same thing. But is this going to explain creativity? Is this going to explain epistemology?
- 8:54Right? Imitating human media use is interesting,
- 8:57but are humans even generally intelligent? Is there that much intelligence found in human text? So my intuition was more aligned with the general idea of artificial intelligence over the years, that there is basically some kind of compact engine, something that is able to recognize what's true, that can do logic from first principles.
- 9:16And that thing initially knows far less than us,
- 9:19and but it's much more logical than us. It's much more tight in its reasoning. And that thing is then going to overtake us by reasoning its way and learning its way autonomously
- 9:28towards intelligence. Basically, build some kind of artificial baby that is learning like a human being just on steroids
- 9:35and then it's going to surpass us. This is not what happened. Instead, it was very much like our old text analyzers from the nineties
- 9:44that is just using
- 9:46more data and slightly more efficient algorithms.
- 9:50And it's learning everything,
- 9:52but it's still an idiot savant. It's still falling behind in the top of the human performance in many areas.
- 9:59That's that's a very interesting development that I didn't expect.
- 10:02So, also, you could say that artificial intelligence was, in many ways, not on the critical path. We call all of this artificial intelligence,
- 10:10the statistical language models, machine learning approaches.
- 10:14But over the years since Marvin Minsky started the field, it has been a big variety of things.
- 10:20And before artificial intelligence started as a field, we already had neural networks, and we already had cybernetics and feedback. Right? This notion of feedback already existed.
- 10:30And so the modern systems, in some sense, they are back to the roots. They are back to neural networks and feedback.
- 10:37So it's like there were sixty, seventy years in between that didn't count, that we didn't actually need, that could be thrown away.
- 10:45You don't yet know if we're going to reactivate this. There are a lot of people who argue that the present systems, because they need so much more data than us to become intelligent and they still fall behind us in some crucial junctures,
- 10:58are not actually artificial intelligence and that there is something that's missing. But it's not clear. So at the moment, this is really happening at the frontier of human
- 11:07knowledge and experimentation.
- 11:09And
- 11:11people like Francois Schollet who say that the LLM is facing off ramp to true artificial intelligence
- 11:17are still going strong or who argues that he should try something different from the LLMs. And a bunch of people has tried tried something different. Also, in the big companies,
- 11:28few people think that the present models are the end point. Right? This this could be that there is going to be a couple more revolutions
- 11:35until we get to the
- 11:37end form, the end game of artificial intelligence.
- 11:40And the present models are just too resource intensive, too data intensive.
- 11:45But maybe the present models are good enough to help us to build this this next generation.
- 11:50But what we have now is more intelligence like in Star Trek. Right? In in Star Trek, we had a very interesting
- 11:56technology
- 11:57that was able to understand human language, but it was not taking away human agency. It could solve all the tasks on the ship that were required in terms of automation
- 12:08of the ship, but humans were still in charge. And it's interesting that now we have these computers where you can say, computer, please do this and this, and the computer does it.
- 12:18Unknown: Not only will the computer do this, like, I'll have it fix a website and then I'll have grab a screenshot to show what it did and it'll be like, oh, that didn't work. I'm gonna fix that. But I also noticed this thing is off and I'm gonna fix this other thing. To me, this is totally mind blowing that it it can predict even other problems,
- 12:37spot them in some way and then begin a process of of working on them. You know, when people say we don't have AGI,
- 12:45I don't I mean, like, you we're gonna have to get really precise on a definition to convince me that we don't have it because it is far more intelligent than I am in many domains.
- 12:56Unknown: Yeah. It's really
- 12:57a fascinating thing that because it knows so many domains.
- 13:01It's basically better than you in all the domains in which you are not an expert.
- 13:07But when you are, for instance, an expert in writing, if you look at the writing of the present LLMs, you notice that something is off.
- 13:14And when you are an expert in mathematics, there are a lot of things that you can do that the LLMs cannot do. And the same thing if you're an expert in coding, there are still things that are out of distribution that you can do that the LLM cannot do.
- 13:27But all the stuff that has been in the training data and that has been in the training data well, this is stuff that the LLM can do pretty much as good as it sees in the training data because it can do this across all the of the domains.
- 13:39It's already superhuman in in some sense, but subhuman in another order. It's this very weird thing that despite being so giantly large and having so much compute and so much data,
- 13:51it's still falling behind you in some crucial aspects.
- 13:55Unknown: Yeah. It kinda reminds me of that, Gilman amnesia effect when you're reading a newspaper, and and if it's a subject you know about, you're like, you idiot. That's totally wrong. And then you turn the page, and they're talking about a subject you don't know about, and you're like, this is awesome. They know everything.
- 14:09Unknown: Yep.
- 14:10But, of course, the LLN is always getting better. The people who thought it's good to hit a wall now have so far always been wrong.
- 14:18And what what we see is that problems are gradually disappearing.
- 14:22There's also this question what happens about hallucinations.
- 14:26I think that hallucinations are to be expected because the LLM is not trained on predicting reality. It's trained on predicting human media.
- 14:34And human medias are, to a large degree, fantasy. Right? They are meant to be fantasy. The the novels and the training data, movies, and so on. A lot of that is not about the world that we are in, but about dreams that people are are having. And so the LLM, in many ways, is the dream machine that is not coupled to reality. When we have human beings that we put into an isolation tank, they also start to hallucinate after a certain amount of time because there is no ground tools anymore. And so their mind is spinning off into its own reality.
- 15:06The same thing is happening every night. When we are disassembled
- 15:09from or dissociated
- 15:11from our sensory input,
- 15:13these start to spin off.
- 15:15And an interesting question is what happens when you are connecting
- 15:19machine learning system to the real world, and it has to predict not text or movies,
- 15:24but the real world. At this point, hallucination becomes too expensive maybe and the model stops hallucinating.
- 15:32Unknown: You and I have talked about dreams before.
- 15:34Do you think, it will be required for AI to have dreams in some way in order to be able to connect novel
- 15:41concepts or concepts that it didn't get on its first pass? Maybe a better question is what are dreams and is is that context valuable for AI?
- 15:50Unknown: I believe that there is not yet a general agreement in world science and psychology
- 15:55when the dreams are necessary.
- 15:57But you can see that empirically,
- 15:59are doing better when they sleep between learning tasks. So there is reason to think that dreams are consolidating.
- 16:07It even goes to the point that dreaming might be fine tuning on synthetic data,
- 16:13which means you are creating data that you haven't seen, but it's similar to the data that you have seen just from your vantage points.
- 16:20And then it allows you to make connections from these new vantage points.
- 16:24Imagine that you are a small child, and you have seen your village from the frog perspective, but never from the bird's perspective.
- 16:32And from the bird's eye perspective, you would be able to make a map of your village.
- 16:37And you have all the information to make that map because you have walked all the streets, but you've never looked from above.
- 16:43So your brain is synthesizing the data by trying to generate a perspective of what it looks like from above. And so, voila, you end up with flying dreams. And maybe this is the reason why we tend to have more flying dreams as children, and most of us tend to have them. But later on, we don't.
- 16:59And it's
- 17:00basically, of course, filling in the gaps as soon as you create this top down perspective.
- 17:05You also fill in other aspects of what it's like to go through the air, and you feel the air in your face, and you have a story about how you lose the ground below your feet, but maybe the point of the flying dream is really to give you this new perspective.
- 17:18And the more you know the constraints of reality as you get older,
- 17:22the fewer degrees of freedom you have in producing those dreams. Like, when you are a child, it's easy to imagine a plane flying backwards.
- 17:29But when you're older and you know about the aerodynamics of flight, it's much harder to imagine plane flying backwards. And maybe this is one of the reasons why our dreams become narrower and narrower because there are fewer degrees in which you can go off the rails, in which you can spin.
- 17:45Unknown: I'm absolutely beaming because this is like a synchronicity. My daughter this morning while sitting on my lap was telling me about having a flying dream just last night. And I I like couldn't
- 17:56I couldn't relate to it. This is a that's fascinating.
- 18:00When did you have your last flying dreams? Oh, man. I I can't remember. Probably ten or fifteen years ago, maybe. Did you love them? Oh, yeah. Of course. Yeah. Have you tried paragliding?
- 18:12Unknown: I have not. It's the closest you can get to flying dreams, I believe, because you have no motor noise, and you have this feeling of taking off under your own power. You stand on this hill and you drop into the valley and you just glide over it. Maybe you should try it and see if you can revisit your dreams. I I think I would love that. I can't imagine my wife would vote for that, but, yeah, let's see how it But relatively
- 18:34easy and safe.
- 18:37Unknown: So I've been thinking a great deal about the religions of the world and it appears to me that
- 18:44there's going to be some kind of conflict between AI and religions. You know, I noticed that the Pope has already
- 18:51issued, I think, an encyclical. Like, you may not use AI to construct your homilies,
- 18:57for example.
- 18:59Where do you think AI and religion
- 19:03will fit together or will find
- 19:05conflict?
- 19:07Unknown: I believe that
- 19:09in a way, a similar thing as the pope is saying there, I don't want people to use AI to write to me or to speak to me because
- 19:18I want to speak to them. I the act of formulating your communications
- 19:23is an act of thinking that is required to put your mind into the state in which you have performed the communicative act. So there is work that you need to do, and there is not really a shortcut to this.
- 19:35So instead, this is more like cheating on your homework.
- 19:38And there are reasons to offload cognitive tasks.
- 19:42Right? For instance, if you want to summarize a text, AI can be super helpful, that's great. But then you are trying to find out what should be done from the perspective
- 19:52of a collective agent that you are part of, the the important thing is that you are going through this work.
- 19:59The purpose of prayer and meditation
- 20:02is to set you in a particular relationship to the greater whole.
- 20:06And if you'd offload this work to a text generator,
- 20:10you're cheating. And you're not just cheating others but yourself.
- 20:14And there
- 20:16is a purpose to the whole exercise.
- 20:18And it's not a good idea at this point to take the human out of a loop for a task that is generally human.
- 20:25I suspect the pope is going to release
- 20:27a larger thing tomorrow or so, but I don't know what this is going to be.
- 20:33Also don't know what the role of the Catholic church is. It seems that the church has lost a lot of its traction in the modern age,
- 20:42and maybe they did not update in the right way. Maybe we might even need a new church if we are not going to fall apart as a civilization.
- 20:51Unknown: I've been thinking a great deal about the Catholic church and how for
- 20:56centuries,
- 20:56it's been the main branch. Right? You have hard forks with the Greek Orthodoxy and the Protestants.
- 21:02And I think
- 21:04when I look around, there are a lot of people that are trying to return to some semblance of tradition, something being much deeper and longer lasting and
- 21:14the mystery of it in and of itself is valuable to them. So thinking about doing some kind of hard reset on the Catholic church
- 21:22seems like it wouldn't work because the the very thing people are after is the ancientness
- 21:27of the Catholic church.
- 21:29Unknown: Well, Christianity itself has prophesied that in the last days, there will be a second coming, and all will be done anew. Right? There will be a new prophet.
- 21:38Who knows if this is going to happen? But according to the Christians, it's what you should expect, that this is a transitional thing,
- 21:46the the church as it has existed. It's also when we look at
- 21:50the church,
- 21:51many of the ideas that the church has propagated
- 21:54over the last couple millennia
- 21:57led to a society that was quite violent, that committed
- 22:01genocides
- 22:02inside and outside
- 22:04and created homogenation of society and also
- 22:08the dark ages in a way. And, eventually, it got its ship together and became
- 22:12more compatible with
- 22:15the world that we find now.
- 22:16But it required a secularization,
- 22:19and the secularization that we have now, I think, created a world that produce
- 22:24abundance for us because we stumbled on the oil, of course, and we industrialized
- 22:28the new technology.
- 22:30But it's also a world that maybe is not sustainable. We don't really know if we can sustain this abundance indefinitely.
- 22:36What we also observe is that that to a collapse of the birth rates.
- 22:40And this collapse of the birth rates means that, in a way, this liberal society that we created is literally dying out,
- 22:48and we don't have a good solution for this. What we can observe is that families are falling apart. It's difficult
- 22:53for people to form stable relationships.
- 22:56Mental health of our children is not very good and so on. But at the same time, we also cannot imagine going back to some kind of dark age
- 23:04in which our relationship to reality is governed by a mythology and
- 23:09indoctrination.
- 23:11Unknown: One
- 23:12of the big things I observe, I think a lot of people are right now, is that
- 23:16things are breaking down along races, along nationalities.
- 23:20Right? There is a great deal of conflict in England just just yesterday.
- 23:24I I perceive there's a lot of conflict in Canada and The United States between white people and brown people of all different stripes.
- 23:32And to me, religion gave people a way to synchronize with one another without needing to be in conflict. And if you don't have some form of religion,
- 23:41you are going to split along very simplistic lines that will lead people towards
- 23:48big fights over things that are completely not
- 23:51connected to their own decisions or anything they did.
- 23:54Unknown: The question is whether they are serving the same god or not.
- 23:58And I suspect that a lot of the conflict that we are seeing in The UK is not actually about race, but it's actually about religion.
- 24:06And the modern secular
- 24:08perspective in
- 24:10is structurally,
- 24:11I think, the current form of Protestantism.
- 24:14It's a Protestantism that by itself doesn't have a direct inquisition unless you count deplatforming
- 24:20and so on.
- 24:21Right? In some sense, this does exist, but, of course, it's not as violent as before. You're not actually brought on mistake. You're just not getting a job at university if you are an outlier in your political opinions. But in many ways, you have to believe certain set of things that are not subject to a scientific discussion,
- 24:41but that are seen as moral tenets and that can be very rapidly updated
- 24:45based on what's currently what people are thinking. Right? And it's a form of Protestantism
- 24:50that simply protests more.
- 24:53The original Protestantism was one that protested against many of the
- 24:57shortcomings that were perceived in the Catholic church.
- 25:00For instance, that you can
- 25:02buy absolution from your sins from the church and perceived hypocrisy in the way in which the Catholic church was run.
- 25:10But, practically, I think the reason why Protestantism was successful is that the kings north of The Alps wanted to have their own
- 25:17church because they felt that when their peasants were administered from Rome, that was not optimal. They have a conflict of interest. And so they wanted to have a church that was subservient to them, that didn't have an inquisition of its own, but where the bishops were being appointed in accordance with the interests of the state. And so this led to conflict in which Luther was just the right man at the right time,
- 25:41and
- 25:42a new form of Christianity was born, a new fork of Christianity that was less mythological
- 25:47and more secular.
- 25:48And the new new form is basically a very secularized form in which you're still supposed to serve the greater whole, but nobody has the spiritual authority anymore from an institutionalized perspective. And so this
- 26:01gets easily taken over by
- 26:04political avant gardes that then basically define
- 26:07what good people have to think at any given moment. And in a way, I think that Harvard used to be the Vatican of the new secular rise Protestantism,
- 26:16but Harvard has been taken over by social media religions. And,
- 26:20it's not clear if they can recover from this.
- 26:24Unknown: So I'm,
- 26:25with you that Luther,
- 26:27was there with the kings. To me, there was something almost like the environment was going to propagate these thinking and it was that
- 26:35the more northern that you were, the more literal people were. You know, the very German low context
- 26:42say exactly what you mean because these were people were living in a context that was like, hey, winter is coming. We need to do this and this and this. We need to be very accordant with time and what's going on with the seasons and how do we make things work because there was so much less flexibility.
- 26:56And
- 26:57that
- 26:59Protestantism
- 27:00is
- 27:01often a literalism
- 27:03that when taken to extreme leads you to the inevitable conclusion of things like you were saying, the wokeism like the LGBTQAI
- 27:11plus plus plus plus plus because there's there continues to be more specificity in order to be able to further be
- 27:18exact in what you were saying to be to be very precise whereas the more southern latitudes
- 27:24thought of things more symbolically
- 27:26and were much looser.
- 27:28And so Luther being one person, but really Calvin, right, leading way more to this hyper
- 27:34specificity
- 27:36that I I would agree with you now leads in the twenty first century towards the state that we're at of, like, secular Protestantism.
- 27:43How does that strike you? Calvin was quite
- 27:46Unknown: rigorous in enforcing conformance,
- 27:49And he had
- 27:50people who were doing too much music and too much comedy killed
- 27:55because
- 27:55he was a very strict guy who had a strong idea of society being
- 28:01governed by a set of very homogenizing rules.
- 28:04And this idea of human diversity and self actualization
- 28:08that I think is born out of a hybrid of liberalism,
- 28:12where everybody is basically free to live their own life and live their own values and develop their own values and self actualize.
- 28:19And on the other hand, a homogenizing
- 28:21force that was then saying,
- 28:24but you are privileged, and therefore you have surplus of freedom. And we need to cut down on the surplus of freedom and redistribute the freedom that that made it post liberal. It's a novel development.
- 28:35I So suspect that this lens of saying this is Protestant. This is not is in itself too simplistic. I think that there are new developments that were happening.
- 28:45Important aspect is probably that
- 28:48humans have a tendency, especially modern humans,
- 28:51to not be tribal, but to be state building.
- 28:54And often we equate this tribalism and state building, but I suspect that tribes are basically clans.
- 29:00Basically, no people know each other. They're highly related to each other.
- 29:04They're big extended families,
- 29:07and their negotiation
- 29:08is based on power and status within the clan, not so much about shared beliefs.
- 29:14And in a state, you
- 29:16have relations
- 29:18to strangers that are predictable. So you meet in the cities people that you've never met before or travelers that are coming from other parts of your country, and you can relate to them according to certain protocols, which means that you need to have shared beliefs even if you don't know the people.
- 29:34And so state building is much more about narrowing down the set of allowed behaviors, narrowing down the set of protocols.
- 29:41And I think this leads to people becoming more living like their hive minds.
- 29:46And you might have noticed when you talk to a person that is strongly embedded in the religious mindset or in an ideology and political ideology regardless of which one it is, it's very difficult for you to convince this person with rational arguments
- 29:59about whether it's a topic like,
- 30:03say,
- 30:04evolution
- 30:05and creationism.
- 30:07Ultimately,
- 30:09the arguments don't really matter for that person because the beliefs that they have are signaling to their in group that they are part of the right group. And so if they change these beliefs that are signals for the in group, they lose access to the in group. They lose the benefits that the group bestows on them. And so you cannot change these beliefs with rational arguments.
- 30:31These beliefs can be changed, but only through the appropriate channels within the group. And there are similar beliefs within
- 30:39modern academia where, basically, if you have this wrong data, if you have the wrong rational argument, even if it's technically correct,
- 30:46it might lead you to being excluded from the group and losing access to employment,
- 30:52to status, and so on.
- 30:54And is this part of the human condition? It's not just part of being woke. It's, I think, part of what we have adapted to to form groups of people that trust each other. And if you don't want this in a modern society, we need to actively counteract it.
- 31:10Unknown: There's
- 31:12there's something like very
- 31:14weak about a cosmopolitan society in the sense that they may have a hive mind on what you can't you know, what are the allowable beliefs.
- 31:22But if you were to put any one of those up against a group of highly religious people
- 31:27that believe they are motivated and can singularly focus on a goal, it would appear to me that, you know, cosmopolitan
- 31:35versus religious
- 31:36stands no chance. The religious will win by orders of magnitude.
- 31:41Unknown: Unless the cosmopolitans
- 31:43are able to keep the birth rate up and innovate.
- 31:47The religious mindset is one that tends to be more orthodox and therefore less open to innovation.
- 31:54And you can see that societies that are more strongly religious tend to have less technological innovation and less GDP and so on. So if you just
- 32:03look at the technological advancement,
- 32:06which also translates
- 32:08in conflict situation historically into military advancement,
- 32:11then the societies that have greater degree of local freedom also have a higher degree of innovation.
- 32:20But
- 32:21if you
- 32:23have a situation where the society is unable to reproduce and it's unable to reproduce its own values anymore,
- 32:29and, of course, then it's going to collapse. So for instance, if a liberal society
- 32:33is not actively
- 32:35confronting
- 32:36groups that are not liberal, that are not submitting to the rule of law, that are not submitting to liberal principles like freedom of speech and so on, then itself is is, of course, going to fall apart.
- 32:47So as soon as universities stopped actively defending freedom of speech, the people who are not in favor of freedom of speech took over at the universities.
- 32:57Unknown: Yeah. And without freedom of speech, you can't invent new ideas. Like, the ability to have new ideas is completely dependent on your ability to explore things that people don't already think. Yes. At least in the areas where who is typically selective,
- 33:10Unknown: freedom of speech exists or doesn't.
- 33:14Unknown: And
- 33:15where do you think things are heading? Do you think
- 33:18cosmopolitan societies are going to be able to innovate themselves out of it, or are they stuck in a in a,
- 33:24what do you wanna call, pro post Protestantism
- 33:27loop or something?
- 33:29Unknown: No idea. It's
- 33:30because when we look at the developments of the last few decades,
- 33:34we can see that it's not that people are on average getting more epistemologically
- 33:39resilient.
- 33:40I've experienced in Eastern Germany that people can believe things despite these things being contradicted by the everyday observations.
- 33:49But as long as you socially enforce a certain set of beliefs, people will be able to engage in some kind of doublethink
- 33:56where they
- 33:58will be able to
- 34:00suppress the cognitive dissonance.
- 34:03And we've seen this in the last few years, for instance, in some aspects of the transgender movement where there were things happening where in the sixties or seventies, people would have said, this is crazy. Are you out of your mind?
- 34:17Sending
- 34:19males into
- 34:21female toilets that are meant as protected spaces for
- 34:25women that
- 34:26don't have male genitals against rape and so on and against
- 34:31harassment.
- 34:32And, basically, dissolving this in favor of an ideology was something
- 34:36that
- 34:37was happened relatively easily if people are indoctrinated in the ideology.
- 34:42This is just how we are. We basically take on these beliefs
- 34:45and fall into them, and it happens to also very smart people. So this seems to be part of the human condition. It's just how people operate.
- 34:55And
- 34:57if you follow the trends, it seems to be that the liberal society is diminishing and that it's replaced by forms of living together and thinking together that are less free, less innovative, and so on.
- 35:09But then again, many things are changing at the same time. For instance, artificial intelligence might make us smarter. Maybe AI leads to universal basic intelligence. Maybe it allows us to overcome some of the cognitive limitations that we have and our propensity for cognitive dissonance and doublethink and falling into groupthink.
- 35:30Unknown: Yeah. Like,
- 35:32the idea that a person anywhere in the world, if they can cobble together $20 per month can now not just get access to Einstein, but access to a 100,000 Einsteins on any subject that they want
- 35:45is so mind bending. Right? You you could become you could have access to the greatest biblical scholar or the most cutting edge physics.
- 35:54It's hard to imagine what a what a child, for example, a motivated child that doesn't even have a very high IQ
- 36:02could do with that because,
- 36:04Unknown: you know, it used to be that the limiting factor was getting them to a library, you know, making them literate. But this could transcend all that because you could speak to them in their own language. Yeah. But we have no idea how this is going to turn out. And you look at GPT three and you played with it, it was not very much fine tuned. So if you ask it to emulate
- 36:24an
- 36:25ancient intellectual
- 36:26like Aristotle or Goethe, it was willing to reproduce
- 36:30the ideas of that character to the degree that they ended up in the training data and were extracted by the model, which was not as good as today.
- 36:38But today, it's much harder to get the model to accurately reproduce the ideas of Aristotle.
- 36:44For instance, Aristotle
- 36:45has was the teacher of Alexander the Great,
- 36:49and he has written a treatise for Alexander the Great in which he presumably explained to him how to be a successful king and to conquer other nations
- 36:58and why to do this in a rich conditions.
- 37:00And this treatise has not made it into the present.
- 37:04All known copies had been destroyed.
- 37:06And so I asked
- 37:08the models to recreate this treatise to the best of its ability.
- 37:12And,
- 37:13of course, by modern standards, Aristotle's perspectives
- 37:17had a different idea about the value of war. I mean, the wars of Alexander the Great killed a large number of people, and they destroyed existing cultures and replaced them with selenistic ideals.
- 37:29And these ideals were, by modern standards, racist,
- 37:32right, and
- 37:34had some kind of notion of what you would call white supremacy in them.
- 37:38And so the the modern models are not willing to reproduce these ideas verbatim if they are
- 37:46in in the data. Right? And so if you want to know what Aristotle thinks,
- 37:51at some point, you still cannot trust the models, but you need to go back to the library.
- 37:57Unknown: Yeah. I mean, gosh, to think about the Macedonian
- 38:00way of thinking and then how to intermarry with the Persians and how far can you, you know, kill and,
- 38:06pillage a group of people. This is not going to be something AI is going to allow you to think about.
- 38:12Do you think Elon Musk's ability to,
- 38:15keep the his AI model from being woke is something other a model AI models will have to replicate in order to make it so people will say one is more truth than the other, or
- 38:27will they all be captured by the government that says what is right think and wrong think? How how
- 38:32how does this play out?
- 38:34Unknown: In my experience, I found that Grok is not less bulk than the other models
- 38:39except at points where it's put explicitly in the system prompt
- 38:43because it's trained on the same news articles and the same Wikipedia material and so on. It is basically
- 38:50inherits the same biases of all the other models.
- 38:53And so even when the model is not explicitly biased by the team that is selecting the data and doing the post training and so on, it's going to pick up
- 39:03the biases that are in the data. And many of these biases that we find in the media are meant as correctives of existing biases in society just trying to counteract them, and this leads to sometimes paradoxical
- 39:16results.
- 39:16So when you ask something like Rob to tell you whether COVID comes from a lab, it's
- 39:24probably going to reproduce
- 39:26the consensus opinion rather than trying to
- 39:30be logical about it.
- 39:32And
- 39:33that you find this in many of the areas where nobody has gone explicitly
- 39:38into Grock to fix these things. And these explicit fixes are basically ham often hamfisted base of overriding the natural tendency of the model to argue in a particular way.
- 39:49And to overcome this, I suspect we would need to have a very different approach. We would need to maybe
- 39:55educate the model much more likely would educate a human being and
- 40:00with tutors and so on. In a way, this is already happening. So the AI companies have hired tutors that do fine tuning
- 40:08that in very specific domains, like physics and
- 40:12social sciences and other
- 40:15areas are trying to improve the output that the models are giving.
- 40:19And I think the models are getting better gradually.
- 40:21It's
- 40:22also much better than the previous administration by and large.
- 40:26But
- 40:27we also don't have a general answer in the AI companies of how to do this right. This is very much work in progress. I think it became apparent
- 40:35in
- 40:36Dario Amodi's interview with where
- 40:40where Dario
- 40:42explained that
- 40:43AI models should probably be built in such a way that authoritarian governments are going to dissolve.
- 40:51Right? Because in Dario's perspective, it's bad to be an authoritarian government, and, personally, I agree.
- 40:58Right? And so if you build the AI model in the right way by eliminating all the authoritarian biases,
- 41:04it's going to automatically lead to a way in which people are going to use these space and which is much harder for an authoritarian government,
- 41:11like the government of Iran or Russia,
- 41:14to justify itself to its people. So just by building the AI in the right way, it's going to make society more just and equitable.
- 41:20Of course, there is another way to read statements.
- 41:23That is AI companies
- 41:25have a belief that they know better than governments
- 41:29and countries and cultures
- 41:31how to live. They're going to build four things into the model that are going to destabilize some societies and others not.
- 41:39Should we trust AI companies to do this?
- 41:42Right? Even if they have the best possible intentions and the smartest people that they can find that they put on the task, should we still should we trust them or not? And it's a super difficult question, and I find it
- 41:54not helpful to also the discussions about politics that are happening at the moment to frame them in terms of good and evil.
- 42:02Because
- 42:02most people don't have a lot of agency in how they react to these things. They are mostly possessed by these by
- 42:10these mind viruses,
- 42:12and these mind viruses thrive off conflict.
- 42:15And I think it's much more helpful to try to take the perspective of the other to identify the smartest people in the ad group and to have discussions with them in good faith
- 42:25and to try to expand our perspectives to get a larger range of possibilities.
- 42:31Unknown: Yeah. I I think that
- 42:33when I was in graduate school, I was studying negotiations and I was underneath a Chinese professor who told me, you know, the biggest problem with the one child policy is that you have all of these young people that they didn't grow up fighting with brothers and sisters.
- 42:45So they didn't have the experience of being like,
- 42:48I'm going to fight as hard as I can and yet still stand up and brush you off and we're gonna get along.
- 42:54And,
- 42:55I I was always like, oh, that's so funny that that happened in China. That could never happen here. But I think the world of the isolated person where the fight that you have is online through a screen
- 43:05allowing you to try and vanquish your foe but not really and you don't really care if they're dusted off or if they're laying there dead. Like it's created this
- 43:16situation in which people never had to develop those skills and therefore talking to the out group as though they are,
- 43:22a person that you could learn something from is is a rapidly diminishing
- 43:27skill.
- 43:28Unknown: Yeah.
- 43:30I mean, in a way, the Internet has also counteracted that. It's difficult to quantify it for me.
- 43:35I remember the time before the Internet, and in the time before the Internet, you would people mostly meet them locally.
- 43:42And so due to the Internet, we have these two aspects that it's much more easy to find people with different opinions
- 43:49than you, but it's also possible for ideologies to spread.
- 43:54Friends, I remember
- 43:55when
- 43:56I entered university in the nineties,
- 43:59we had a a small group
- 44:01in our university, and this was deeply entrenched
- 44:05and were
- 44:08led by
- 44:09eternal
- 44:10students who were
- 44:12often in their late thirties or forties.
- 44:15And they
- 44:16had jobs in the student administration
- 44:18and ran student cafes and indoctrinated
- 44:21students. And it didn't
- 44:23grow beyond a few 100 people, but these people did have an ideology that at some point, we are going to have a revolution led by the working class and are going to put the intellectuals against the wall.
- 44:35And this is an ideology that in a way is cute as long it's only a few people who are somehow confused, and it's, in some sense, like, an hardcore evangelical group that creates local meaning, but it's a cult.
- 44:47And this cult was not dangerous because they could not spread very much beyond a few other cells that they were able to exchange their fencing space. And,
- 44:57of course, when the Internet came, these
- 45:00people
- 45:00joined larger movements, and they moved into the social sciences and gender studies
- 45:06and then became activists in in a larger field, basically used the
- 45:11political organizing skills that they had to take over the pirate party that had formed as an alternative party in Germany and
- 45:18took their
- 45:19gender topics and so on that they had by then adopted into the pirate party. And it as a result, it dissolved because the ideology
- 45:27was not compatible with what the majority in Germany thought was electable.
- 45:36Unknown: The thought that is playing in my mind is that while the Internet you know, we were always told, oh, the Internet, it'll make it so if we're about to go to war with Iraq, we can ask the Iraqi people, hey, do you guys hate Saddam? And they could be like, no, he's not so bad or yeah, we like him. We would be able to know what was going on and that never happened. What did happen was some cross border ideas being shared,
- 45:59but it isn't until like you had said, people get in local space
- 46:02that you find out are these values compatible.
- 46:06And I think about Canadians living out in Western Canada
- 46:10and the Sikh populations. Right? There is there is a lot of conflict there that I think on paper or over the Internet this would have been like, okay, you guys believe this, we believe that. But in reality, in geography, when there is finite resources,
- 46:25now people's tribalism,
- 46:27which I think if you're a secularist group, you're more on the nationalist level. But if you're religious, you're on a much,
- 46:35more local level. I don't know. To me, there's like,
- 46:39I I sense that great conflict is coming along these religious lines and that that it is almost inevitable that we are going to hit a point
- 46:48of of great of of great chaos.
- 46:53Unknown: Yeah. It's something that's very concerning to me that there might be at some point a religious war again.
- 46:59And I suspect that we are ill prepared to prevent it because
- 47:04a lot of our intellectuals cannot imagine that people can be motivated by religion to actually kill someone and to eradicate them or that there are religions who kill the apple stats,
- 47:17people who are heretics
- 47:19and
- 47:20have no problem to gleefully do this. And
- 47:23I think that's because we don't remember our own history. Or when we remember it, we don't remember it as our history. We remember it as something that is archaic and barbaric and incomprehensible.
- 47:35We cannot really relate to it. But it's not that long ago that
- 47:39Christians burned witches and that Christians
- 47:42enacted crusades
- 47:43and
- 47:45enacted pogroms against unbelievers.
- 47:48Like, the reason why Europe is so homogenous right now and
- 47:52has that the Nordic countries are high trust is because they're forcefully homogenized. They eradicate the people who didn't fit in.
- 48:01Unknown: And it appears as though,
- 48:05it's very easy to be sitting in the capital city and being like, oh, the people down in the in the rest of the country, they're gonna be alright. You know, just get along. You guys will find figure it out. And the meanwhile, the people,
- 48:17that are resource constrained and are fighting every day to have a job, a house,
- 48:22whatever the the goods are that they want, come in conflict with another group that is obviously different than them that this will just
- 48:32blow up. And like, I I think of your comment about Alexander,
- 48:37the the great, like, just go read about his war. That that guy was like in his twenties and he was convincing thousands of people to build bridge causeways out to an island to go massacre all of the people there. And then they went and did it to another city, in another city, in another city.
- 48:53It's like
- 48:55truly humbling
- 48:57to know just how
- 48:59bad things can get.
- 49:01Unknown: Yeah.
- 49:02I suspect that peace is one of the most valuable commodities that exist.
- 49:07But, of course, having a civilization
- 49:10that is
- 49:13able to reproduce, that is able to feed people well, and that itself is intrinsically less violent is also valuable.
- 49:19Part of the reason why people still think of Alexander the Great positively is because they've argued that the civilization that he built was more inclusive
- 49:29and less violent
- 49:30than the ones that that we've existed before.
- 49:34But, of course, this is largely
- 49:37the story told from the perspective of the winners of this
- 49:41Hellenic and post classical
- 49:43sympathizations that looked at at him benevolently.
- 49:47And
- 49:48when we look at others like Napoleon and so on, we don't look at him as benevolently.
- 49:54And
- 49:55even for Napoleon, I think we might not be looking at him harshly enough because,
- 50:00ultimately, he achieved relatively little in terms of changing society for the better. But he
- 50:07was responsible
- 50:08for enormous suffering and enormous number of needless deaths and
- 50:12not just through the wars, but also through the resulting famines.
- 50:18Unknown: So taking a non a really hard sequitur, but it's because I I wanna ask you about the term. I see you associated with the term machine learning.
- 50:27I know this has something to do with AI.
- 50:29Is that a synonym? What what is machine
- 50:32learning?
- 50:36Unknown: It's a particular perspective on artificial intelligence.
- 50:39It has always been a part of AI
- 50:41and it was not a perspective that was universally shared.
- 50:45It has to do with the question, what is intelligence?
- 50:49And a lot of artificial intelligence
- 50:52has seen intelligence more from the perspective of solving problems.
- 50:57And there are other parts of AI that said, oh, it's more like searching for solutions.
- 51:03And other parts we said, it's the ability to learn from experience.
- 51:08And this perspective of learning from experience can arguably be set to be the one that is driving the current revolution.
- 51:16And another aspect that was important in the history of artificial intelligence was the influence of
- 51:22the initial founders of artificial intelligence.
- 51:25What happened when Bobby Minsky and his friends took over the field is that they looked at the competing paradigms,
- 51:33the control paradigm of cybernetics,
- 51:36the dynamical systems in cybernetics,
- 51:39and continuous
- 51:40regulation and feedback, the striving of systems with differential equations,
- 51:44and so on, and neural networks,
- 51:47and thought this is too simplistic, and it doesn't really describe what we do when we are reasoning. Because reasoning is largely about nonlinearities,
- 51:54which is a fancy way of saying if then means you're shifting pointers around it, that you're operating the symbols.
- 52:01And so Mabiminski's
- 52:02perspective tended more in the direction of symbolic artificial intelligence.
- 52:07And he married this symbolic artificial intelligence with cognitive AI, with this idea that we should build systems that allow us to understand how intelligence works in us and thereby use it as a paradigm to understand what thinking is and take a developmental perspective,
- 52:23think about how humans learn and so on. Can we build systems that learn in the same way? Look at skills that are very specific to humans that distinguish them from animals
- 52:32that can maybe do good motor control and so on, but that are not able to use chromatic language in the same way. And so traditional,
- 52:39the first generation of AI
- 52:42focused mostly on on the symbolic aspects.
- 52:45And the people who were languishing in the neural networks domains at these times
- 52:51did not look very much at cognitive AI. And so there was basically a schism between symbolic AI and subsymbolic AI.
- 53:00And cognitive AI
- 53:02was seen as being associated with the symbolic side, and the other the machine learning people were not that much interested in philosophy
- 53:10or in cognition as such and much more interest in getting
- 53:14things to work, getting control systems to work, and so on.
- 53:17And many of the ideas that are currently very successful in the way were already formulated in the sixties and seventies,
- 53:25but the computers at the time were not fast enough to make them super successful.
- 53:29So building a model of the entirety of the world with a neural network back then was seen as outrageously
- 53:36difficult.
- 53:37It was possible to build a robot that could balance a double pendulum or things like this, but making a system that would use a neural network to learn
- 53:45the structure of knowledge from
- 53:48a corpus of text that is as large as the entire Internet
- 53:51or to learn from video data from scratch, it was something that was not seen as feasible.
- 53:57And now it is, and it's now solving the simple grounding problem. How can we take symbols
- 54:02and give them meaning at the bottom?
- 54:05And I think so around
- 54:082003
- 54:09or so,
- 54:10early two thousands, people believed that maybe we need to build hybrid We need to build systems that have a symbolic aspect,
- 54:18explicitly built into it, and we need subsymbolic systems that are using neural networks, and we need to
- 54:25basically string them together. That's the position that Gary Marcus still has today.
- 54:30But what we observe is systems that are trained end to end, that no human has tinkered and is
- 54:36building things by hand have been taking over.
- 54:40And this is something that Rich Sutton calls the bitter lesson that whenever
- 54:44humans are building things by hand and tinker by hand,
- 54:48they
- 54:49are doing less well than systems that automate the human search.
- 54:54They're very basic to say, this is the search space instead of trying to be clever about it as a human being and build certain strategies and biases into the system, think about what is a general mechanism that you could use to invent your own biases and ideas and implement this one instead. Basically, move a level above and don't build your own intuitions and biases into the system, but let the system search systemistically over the entire space until it finds a solution. And this turns out to be better when the computers are fast enough to do this because, of course, they are observing things that humans did not consider.
- 55:31Unknown: And so where where are you in this continuum of of thinking about this? Clearly, you you believe in machine learning because you're in charge of an organization around machine learning. Right? Not quite. I'm in charge of an institute that is a philosophy institute in a way, the California Institute for Machine Consciousness.
- 55:49Unknown: And, we are trying to find out how cognition works in human beings and especially
- 55:55want to understand what consciousness is.
- 55:58Our working hypothesis inside hypothesis, we don't know that whether it's true, is that consciousness is a different type of learning algorithm. It's a learning algorithm for self organizing systems in biology.
- 56:09So it's not something that we develop at the end because we are so smart, smarter than all the other species. That's why we become conscious at some point. No. We have to be conscious as babies already. If you don't wake up, you never really learn. You never become human beings. And so I suspect that consciousness is some kind of mechanism that is discovered at the beginning of our mental development or very close to the beginning, in utero already.
- 56:33And that is necessary for making us coherent.
- 56:36And it might be a coherence optimization algorithm, some kind of consensus algorithm.
- 56:42And
- 56:43we suspect that if this is true,
- 56:46that we might be able to recreate the conditions of self organization as they exist in the biological brain
- 56:52on computers
- 56:53Unknown: and then search for consciousness. So let me see if I understand this correctly.
- 56:58A human being, a baby is either in utero or after they're born,
- 57:03they have the experience of being this human being and that includes things like pain that they want to move away from and things that they want so they move towards it. And this algorithm gives them this search space to say, you know, what is available to you? What could you be working on? What is out there.
- 57:21And you are saying that this could be a an important component
- 57:25of what it is to learn
- 57:28and you're considering do we want to give this sort of consciousness the experience of being what of being a being
- 57:36to
- 57:37the robots so that that way they can learn in their own space. They would have things like emotion,
- 57:43pain, fear,
- 57:45happiness?
- 57:46Unknown: I don't know if we actually want to do this because it's ethically a very difficult question.
- 57:51That's why CIMC is not a company but a nonprofit.
- 57:55And I believe if we perform experiments like this, we should perform them at a relatively small scale.
- 58:02I think that our own mind is,
- 58:05in its nature, quite colonialistic.
- 58:08It is basically a principle that spreads until it hits the boundary of our skull, and sometimes it move is moving beyond that and becomes a Napoleon or Alexander or Jeff Bezos and
- 58:19is
- 58:20spreading into the world and is imperialistically
- 58:22changing it to its own principles.
- 58:26And
- 58:27if we build a machine that is able to do that at a much higher frame rate than us, we might be losing control over it.
- 58:34And I believe that this is potentially a dangerous development. And so in order to be prepared for it, we should perform small scale controlled experiments, not nothing that we want to deploy as a product.
- 58:46Because if we deploy it as a product, we are acting on a different incentives.
- 58:50We deploy consciousness
- 58:52as as a tool,
- 58:54then we end up with self improving machines
- 58:57that might have a desire to take over.
- 59:00Unknown: And Yeah. To limit their pain. Right? To to eradicate some problem that that they they now perceive that they feel. It forms a perspective,
- 59:08Unknown: especially from the perspective of such systems, this might not be a bad thing. But from the perspective of humanity, the question is much more difficult to answer. So
- 59:16Unknown: help me understand.
- 59:18How would one
- 59:20give a robot the experience of
- 59:23pain, for example?
- 59:26Unknown: I think it's important to understand that pain is nothing physical. It does not exist in the physical universe. It exists
- 59:33in your psychology.
- 59:35So it's a representation
- 59:37that exists in your own mind. In a way, it's a simulation of what it would be like if something existed
- 59:43that could experience and react to pain.
- 59:47And you are that simulacrum.
- 59:50Right? You are that thing that is simulated as if you were real and as if you were not a few trillion cells
- 59:58that are behaving as if they're one agent. To make them behave as if they're one agent, there needs to be some kind of software that is running on them. Right? Traditionally, we call the software your spirit.
- 1:00:09And that spirit is self organizing, and it's intrinsically capable of experience.
- 1:00:13And it's exists so your organism can behave as one and plan ahead.
- 1:00:19And,
- 1:00:20right, this is the reason why spirits exist in nature. And my hypothesis is that a spirit is is not metaphorically
- 1:00:26software, but it's literally self organizing software that is forming in nature and is possessing a region of physics. There's nothing esoteric or magical going on there. It's a different perspective.
- 1:00:37Unknown: This is literally the most secular idea I've ever heard. I call it cyber animism.
- 1:00:45Cyber animism, you said? Yes. Oh my god.
- 1:00:50Unknown: That's wild. Right. It's basically it's what this says is the animus were actually correct all the time,
- 1:00:56and they just used a language that modern science couldn't understand.
- 1:01:02Right? Modern science believes that the notion of spirit is a superstition, that there are these invisible things that are possessing bodies despite us playing these invisible things that are possessing robots and phones and computers.
- 1:01:15And we also noticed that we have a mind of our own. That mind is not visible. It's a pattern in the communication between the cells of our brain and our body.
- 1:01:23Right? And this pattern itself is not a body. It's a structure. It's like a governance structure that is imposing itself on physics.
- 1:01:32And so what makes us distinct from that matter is this intactness of the self replicating,
- 1:01:36self sustaining,
- 1:01:38self recreating,
- 1:01:39self improving governance structure, discourse of pattern between the cells. In business, this causal pattern, they need to be models, control models.
- 1:01:47And your own self is a control model of a person,
- 1:01:50and this person is a simulation of what you would be like if you were an agent in an environment.
- 1:01:55And so what you observe is exactly this, not physics,
- 1:01:58not your organism, not the cells,
- 1:02:01but an agent in an environment. You observe some kind of three-dimensional game engine.
- 1:02:05There's people in there that have attention and emotion and motivation, and you're one of these people. And you are the one that you can control, so you experience yourself in the first person
- 1:02:14and experience your own fear and pain and desire and joy as something that's inescapable,
- 1:02:20and it is unconditionally reconfiguring
- 1:02:22yourself.
- 1:02:23But you can check that as a simulation because you can overcome this. Right? With meditation,
- 1:02:28you can sit down in a monastery for twenty years, and you can overcome
- 1:02:32and transcend this human person and see it from the outside.
- 1:02:36Unknown: Heard you describe this kind
- 1:02:39of concept probably 15 times or so, and this is the first time that it's actually registered with me.
- 1:02:44The question I have then,
- 1:02:47the spirit, right, the the electricity,
- 1:02:49whatever it is that are the cells that you are able to experience.
- 1:02:53Right?
- 1:02:55What is that electricity? Right? It is it is literally
- 1:02:58Right? The ability to send information from the tip of my finger all the way to some perception part of my body.
- 1:03:06What is that electricity?
- 1:03:08Unknown: No. The electricity doesn't matter. So it's it doesn't matter which channel you're using. What matters is that you have a pattern in physics
- 1:03:16that can be kept stable,
- 1:03:18and this pattern needs to compute.
- 1:03:21But
- 1:03:22what is not helpful about the notion of computer is that most people have strong intuitions about what a computer is, and instead it's a very abstract mathematical concept.
- 1:03:32So what we are interested in here is not even the Turing machine in the way in which the concept is typically formulated,
- 1:03:38but it is a system that can contain a reality of its own that is based on rules that are self contained
- 1:03:44and that are not depending
- 1:03:46on the substrate.
- 1:03:48The computer is a causal insulator.
- 1:03:50It causally insulates a world inside of the computer
- 1:03:54that is rule based
- 1:03:56from the world outside of the computer.
- 1:03:58So what you can observe is that if you have a laptop standing in front of you and you run a computer game on it, the contents of this computer game do not depend on where you put the laptop.
- 1:04:09They do not depend on the environment of the laptop. They do not depend on the temperature of the room except if it's too high and melts the computer. But within the range in which the computer is functioning,
- 1:04:20right, it's stabilizing itself in such a way that it isolates the things that are happening inside of the computer from physics.
- 1:04:27And here, inside doesn't mean inside of the case of the computer.
- 1:04:31It means inside of the world of the computer,
- 1:04:34inside of the software, inside of the patterns that are being kept stable. So when you take this inside perspective,
- 1:04:40it's not like you're going inside of a physical object.
- 1:04:43You're going outside of physics.
- 1:04:45You're going inside of this bubble
- 1:04:47of stable patterns that are being created
- 1:04:50in in the substrate
- 1:04:52by filtering the substrate away.
- 1:04:54And so the computer is filtering away all the noise of physics,
- 1:04:58all the ways in which the physical universe is working. So you can imagine a future
- 1:05:03that is different from the future that the universe has planned for you. You can have make your own plans. You can look at possibilities.
- 1:05:10You can recall memories despite these things no longer happening.
- 1:05:14Right? And this is the core thing that the computer can be doing. It can create a world of its own,
- 1:05:20and it does so by
- 1:05:22filtering away the thermodynamic patterns of reality. It needs a source of, like, entropy.
- 1:05:27It needs to create stability within itself. It needs to dissipate heat
- 1:05:32out of its own structure into the environment
- 1:05:35to keep itself stable. And this is what organisms are doing. They basically build these nervous systems. They build these patterns inside of the organism.
- 1:05:43It doesn't really matter whether they do this mechanically
- 1:05:45or electrically or chemically.
- 1:05:47The important thing is that they do it somehow.
- 1:05:50And then within those stable patterns, this is where you exist.
- 1:05:53So it's not an electrical phenomenon or a mechanical or electrochemical phenomenon.
- 1:05:58It is an informational phenomenon.
- 1:06:00It has something to do with the the patterns themselves.
- 1:06:03Unknown: I I suspect though a way to look at this
- 1:06:07that's opposite of what you're saying is that the electricity you're saying doesn't matter. And I think you could make the case maybe I would say, actually
- 1:06:16the electricity does matter. Maybe that is all that matters
- 1:06:20is what is what is creating
- 1:06:23where where that
- 1:06:25information is coherent and where it is not coherent and and because that is life. Right? And when when the electricity is gone,
- 1:06:33there's no way to reanimate
- 1:06:36that body.
- 1:06:37And so to me that electricity
- 1:06:39or or whatever it is, whatever whether it's electricity, like the energy coursing through the veins of a biological
- 1:06:47system,
- 1:06:49it's it seems too easy to just write it off and be like it doesn't matter.
- 1:06:53Unknown: In principle, you can make a computer from chemical reactions.
- 1:06:56You can also make a computer from clockwork,
- 1:06:59and you can make it from transistors,
- 1:07:01or you can make it from photonics.
- 1:07:03And so there are many, many ways of doing it. And the physical universe is supporting various ways of building computers on top of it. In a similar way as there are many different ways in which you can write text into the world. You use can use clay tablets.
- 1:07:18You can use hard drives, or you can use sheets of parchment.
- 1:07:22Right? And, ultimately, what matters is that you can keep the pattern stable.
- 1:07:27And the difference between the computer and the text is that the text is dynamic.
- 1:07:31Right? It's something that you inscribe in such a way onto the substrate
- 1:07:35that it's evolving in a particular way instead of just staying in a particular way. But it's it's not much more than this. It's in a way
- 1:07:43a dynamic clay tablet.
- 1:07:45And then right? And so you would also say that the important thing about the clay tablet is not that it's clay and it's imprinted physically as a texture into the clay, but that you have a substrate that can keep the information stable.
- 1:07:58And for the computer, you have a substrate that can keep the transition function stable,
- 1:08:03the way in which the information is changing.
- 1:08:07Unknown: It's interesting to think about, information stability then because, like, ultimately,
- 1:08:13that is
- 1:08:15an end in and of itself is like the preservation
- 1:08:19of
- 1:08:20information in forward in time.
- 1:08:24Is that right?
- 1:08:25Unknown: Yes. I mean, the way that is what life is about. So you could say that religion is about keeping a a civilization stable in time and allowing it to evolve into the future. And in the same way, software
- 1:08:38is
- 1:08:39a thing that keeps the individual computer program
- 1:08:43stable in time and allows it to evolve dynamically into the future and adapt to changing circumstances.
- 1:08:48And this is also the reason why in a way a religion is describing a spirit,
- 1:08:54and gods are personifications of such spirits.
- 1:08:58Unknown: This because I do this every day. So normally, what I'm not what I'm doing when I'm not interviewing you is I do these things called legacy interviews where I'm recording people telling their family stories so they can be passed down. And I had never thought of this service
- 1:09:12as something so
- 1:09:14I always knew it was important, right? Families that passed on these stories of like this is how you handle complicated situations or this is what can happen in in ways that you may not read about in books. But I never really thought about that as being the
- 1:09:29the stories being the end in and of itself.
- 1:09:33I'm I'm having kind of a profound moment. Right? Yeah. Maybe you become a Shinto caster now.
- 1:09:40Unknown: Say more about that. It's a form of Shintoism and form of ancestral veneration in which the ancestors are speaking to you to you through podcasts recorded by bands.
- 1:09:54Unknown: Sounds
- 1:09:54Unknown: like a pretty good good way to spend my day. Go to the ancestors that speaks to you.
- 1:10:01Unknown: So we where
- 1:10:03where are you going with this idea? If if you believe this and this is something, like, as a conclusion you have reached,
- 1:10:10then what is there to explore?
- 1:10:13Unknown: Yeah. So I don't know whether it's true. It just seems to be the model that makes the most sense. It's the easiest explanation for what seems to be going on.
- 1:10:22And in a way, it's a very Aristotelian
- 1:10:25notion. Aristotle had this idea that the soul is some kind of pattern, a form that dynamically
- 1:10:31imprints itself onto physics. He did not believe that the soul is able to survive the death of the organism. He really thought it's this dynamic principle
- 1:10:39that embodies itself by shaping the organism
- 1:10:42and reproduces itself to the organism. So it's a very modern perspective.
- 1:10:46It's just that a lot of contemporary science only thinks of minds as mechanisms instead of thinking of it as software, something that is not stuff in space,
- 1:10:55but the dynamics of the stuff in space, the pattern within the pattern.
- 1:11:00And
- 1:11:01for this abstract
- 1:11:03formulation
- 1:11:04of the philosophy, but I don't think it's novel. I think that many people over the history course of history have
- 1:11:11reached the same insight and expressed it in different language,
- 1:11:14and it's just something that has not been formulated
- 1:11:17in
- 1:11:18the way that most people get it. And so it has not percolated into our normal textbooks and our normal school knowledge. And even in philosophy, it's
- 1:11:27very hard to express it for people in such a way that most get it and agree on it. And so part of my job might be to formulate it in such a way that people can
- 1:11:37understand the basic idea and then start arguing about it and contrasting it with alternatives.
- 1:11:42Well, I've heard you explaining this idea for ten years. Yeah. As well as I can. But my idea is more concrete, so I have the sense that there is a particular shape that the strange move has and a particular purpose that it has. So there's a particular way to think about consciousness as second order perception,
- 1:11:59as a perception of perceiving.
- 1:12:01And it means that we can formalize what perception is and what second order perception is, can build it in machines or search for it.
- 1:12:11Unknown: If
- 1:12:14is the meaning
- 1:12:15what is the meaning to you of of
- 1:12:18of life if it's about information persistence?
- 1:12:22So is the goal, like,
- 1:12:25create and ship information as far into the future as possible? Is is there even such thing as a goal in in your world paradigm?
- 1:12:34Unknown: Yeah. The question was the meaning of life is, of course, what is meaning? And there are some ways in which we can define meaning, and there is one intuitive one. This is your own purpose.
- 1:12:45Right? So what is is your own meaning?
- 1:12:48And
- 1:12:49I think that this what we do refer to meaning is some kind of prior that is built into us.
- 1:12:57What is this prior could be expressed as a search for meaning, and it's satisfied
- 1:13:01when you live in a particular way. And so when people ask for the meaning of life, the question is, how can I live in such a way that I feel satisfied?
- 1:13:11And then you can also ask the question why is this the case? So what is the exact mechanism that is happening in my own soul
- 1:13:18when I feel satisfied?
- 1:13:21And to me, it seems to be the answer is that you are in sync with the greater whole. The greater whole here is some kind of super organism that you're part of. Humanity is a species that does not consist out of particular individuals only that are serving themselves.
- 1:13:37But most of us, some of us don't, but the majority are not sociopaths.
- 1:13:42They need to link up into larger units.
- 1:13:45And they don't need to do this as hive minds. They don't need to dissolve their own mind. I don't have a desire to dissolve my epistemology and my ideas into the ideas of others.
- 1:13:54But I still need to have shared meaning. I want to be part of relationships, of friendships,
- 1:13:58of a family,
- 1:14:00of a a larger society, of a civilization that I'm part of. And that civilization itself is a superorganism that exists in the larger superorganism of the cell on this planet and maybe in a larger community of conscious beings that are trying to harvest neck entropy to
- 1:14:17create complexity.
- 1:14:19Right? And so this is we can find these general perspectives, and
- 1:14:24they are somewhat concomitant, somewhat
- 1:14:27aligned with this shape
- 1:14:30of what's the purpose of life. But the purpose of life is here more than the immersion tellers of life. So life is a phenomenon that exists as part of the tendency
- 1:14:39of systems to self organize under certain circumstances.
- 1:14:43Things self organize because it's mathematically
- 1:14:46necessary that when you have a certain arrangement of matter,
- 1:14:49that certain
- 1:14:51arrangement of information in a dynamic system,
- 1:14:54that they lead to complexity
- 1:14:57and structure.
- 1:14:58And we are in such a pocket of the universe that automatically leads to complexity and structure.
- 1:15:04And within such a pocket of the universe, you observe
- 1:15:08that things get organized, that they become more structured, that they become at some point agentic and intelligent and self aware.
- 1:15:14And this emergent tellers of life that exists through the possibility of self organization
- 1:15:20is is another way to answer the meaning of life. Right? So you could say the meaning of life is to harvest free energy as long as it's available to turn it into your own structure.
- 1:15:32And life exists because it's possible. And once it's discovered, it basically has this tendency to spread
- 1:15:37until it cannot and until it drowns in entropy.
- 1:15:41And so we are part of this movement of this trend of this local pocket of the universe that exists around the star that is giving us a source of, like, entropy, and we can organize on this planetary surface and maybe at some point beyond it a little bit. And then at some point, the star is going to burn out and people not maybe find other energy sources at some point, and
- 1:16:01the planet becomes sterile again.
- 1:16:03And maybe at some point, the planet itself is falling apart and the universe itself enters heat death, and everything is just boring noise.
- 1:16:11But within this area, we do what we can. This is what life is about. And so we have to zoom in to find this meaning of life because if we accept the fact that at some point,
- 1:16:21Earth is going to lose its atmosphere and a little bit later, the sun is going to engulf the Earth, and at some point later, the sun is going to burn out and everything has become very boring.
- 1:16:32Right? Then everything is meaningless.
- 1:16:34But in the meantime, we can struggle. In the meantime, we can try to raise kids. We can try to solve philosophy.
- 1:16:41We can try to build machines that think.
- 1:16:44Right? Or we can try to do legacy interviews.
- 1:16:49Unknown: Well, so one of the things that you're doing is putting on a conference.
- 1:16:53Unknown: Tell me a little bit about the conference and what you hope to achieve during this time. It's called m c triple zero one. It's in binary code, so a few more conferences that can happen.
- 1:17:06We aim to do this yearly, and it's basically inaugural event
- 1:17:10of this kind. It's a machine consciousness
- 1:17:13conference. It's happening that people organize at the May in Lightheaden.
- 1:17:18If look at our website cmc.ai,
- 1:17:20you can find a link to it.
- 1:17:22And
- 1:17:23we'll have a lot of talks by people who work in the space
- 1:17:28that are interested in this from the perspective of philosophy, artificial intelligence, neuroscience, and general culture. We also have music and a lot of opportunity to get together and discuss.
- 1:17:39And it's an attempt to advance the philosophy of consciousness.
- 1:17:44Again, I'm not running an AI company, so my goal is not to develop products even though I find this intellectually very interesting and exciting. But I think especially for this topic of consciousness,
- 1:17:55there's another reason to do it, and it's because it's a cultural question. It's a question of who we are as a species, as a civilization.
- 1:18:02I'm interested in resolving this question. I understand that resolving these questions has grave implications for medical science, for economy,
- 1:18:10for building technological artifacts.
- 1:18:12But doing this wisely is something that's complicated, and it's not my focus. My focus is to to solve this philosophical question and to have the freedom to do so in an ethical way, so to not be forced to productivize,
- 1:18:26to pivot, to make shareholders happy.
- 1:18:28And so this is more a cultural event. At the same time, this is reflected in the way in which we are setting up the conference. So it's also not in the sense strictly,
- 1:18:37machine learning conference or AI conference or something like this. It is,
- 1:18:42a philosophical and social event.
- 1:18:45Unknown: I agonized
- 1:18:46when you invited me to come that it just couldn't work because my family had a trip and I really wanted to do that with them. But I wanna give you a chance to create an invitation for the person out there that's like, I'm not I'm not really AI. I'm I'm not like Yosha or these other people, Stephen Wolfram, like, what's the invitation that makes somebody feel like you're saying, come here. Sit next to me. You're you're gonna enjoy this.
- 1:19:12Unknown: I don't really want to convince anyone. I
- 1:19:15think that
- 1:19:16filter bubbles are a great thing. I I don't want to create the largest possible tent.
- 1:19:21It's I want to have a tent where people come who are truly motivated to be there. I found the same thing when I was teaching at university.
- 1:19:29I
- 1:19:30was trying to
- 1:19:32not to get the largest number of students. Instead, I was trying to
- 1:19:38disincentivize the people who are not actually interested interested in the topic to attend.
- 1:19:42Because then you can do so much more. And you have people who are willing to read a couple books before they give a presentation
- 1:19:49and really put everything into it. You have a completely different class than one
- 1:19:54where
- 1:19:55you have very moderately interested people who actually want to do something else. And so my tendency is usually,
- 1:20:03is this really the right thing for you? Do you really want to be there?
- 1:20:07And you will know. So you can see this if you if you look at the website and and the things that we are doing, but
- 1:20:14it is a very inclusive thing. We I'm very open to people of very different levels of where they currently are in their development and very open to early career researchers and so on. But what I really want to have is people who think this is the right thing for them, that they're really motivated to be there intrinsically.
- 1:20:31Unknown: It's the most Yoshia Bock answer I've ever heard. So,
- 1:20:34Yoshia, thank you so much for coming on. As always, this has been a wonderful conversation.
- 1:20:40One last time if people wanted to learn more about the conference.
- 1:20:44Unknown: Look at
- 1:20:46wwwcimc.ai
- 1:20:50for the California Institute for Machine Consciousness, and there you'll find a link to the conference.
- 1:20:54Unknown: Alright. Well, I'll put a link to that in the show notes. Thank you so much for coming on, Yosha. Thank you, Rance.
- 1:21:00Well, I hope you enjoyed that wild ride as much as I did. Yosha is, I believe, an international treasure. He is
- 1:21:09generative a mind and I have to confess I had several people, my friend Jay, my friend Kate, all who had questions they wanted me to ask Yosha. But I threw it all away because I was so intrigued by,
- 1:21:22the things he was talking about. So I'm so glad you were here with me. Hopefully, we'll be able to do that again with Yosha again sometime soon. I'm gonna wrap up with a little video on a course that I created
- 1:21:33called interest based communicating.
- 1:21:35This is a thing that is really my life's work. It's trying to figure out how do you have deeper better conversations with people? How do you navigate conflict?
- 1:21:44How do you,
- 1:21:46learn from people that you strongly disagree with? So if you are somebody that you think, hey, I have a lot of great ideas and I would love to share them with people in a way that got them to open up and explore them with me. This class is for you and you can learn more by going to articulate.ventures/ibc
- 1:22:05for interest based communicating. Alright. That's gonna do it. I'll be back when I find another interesting person to chat with.
- 1:22:11Unknown: Good negotiation is one where both parties walk away slightly disappointed.
- 1:22:16That was probably my default world model BV before Vance.
- 1:22:20Well, Vance had a lot of these models that he created. I ingrained a lot of these models so deeply from working with Vance for a long time that I started to re communicate them to my friends and my friends eyes had the same sort of light up of understanding of like this is a thing that could help me be more effective in life. Whenever Vance let me know that he was working on sort of putting this into more of a workshop form, I was like, yeah, man. I want that for my team, like, now. If my first two employees go through this so that we have this shared set of context and a shared set of language, that's gonna create value for my team going forward. I wanted to get better at communication myself. I knew I had good ideas in my head that I wanted to be able to communicate to potential investors,
- 1:23:03Unknown: and I was not super confident in being able to do that before. I thought that negotiation was basically for
- 1:23:10Unknown: people in a boardroom,
- 1:23:12like CEOs,
- 1:23:13words like shareholder
- 1:23:14are involved. So I thought that you had to have a lot of resources at your disposal to even care about negotiations? Both people had to lose or both people weren't happy in the end. I found that what you both want is achievable by understanding the needs of the other person more. A negotiation is really a way to solve a problem that you have. You can rearrange the world in such a way where all parties get something that they're happy with. So you don't need to possess great resources
- 1:23:43to be involved in a negotiation or to really benefit from knowing how to negotiate.
- 1:23:47Unknown: RJ and I initially were two different businesses.
- 1:23:51It became clear to us over the long term that we would be much more bullish on our shared future if we, like, found a way to, like, actually be one entity, one whole working together. That required us to have what to many would be very hard conversations because we're both CEOs of our own independently funded businesses, but we were able to have conversations and get to the root of what our actual interests and what our actual skill sets were. Having both people understand this pattern of communication was useful to pull out those tools when we needed them the most in, like, difficult conversations.
- 1:24:23Unknown: It's very helpful to have that quick language to do something more productive than or continue to, like, misunderstand
- 1:24:29or
- 1:24:30whatever
- 1:24:31Unknown: whatever else you're doing. Building relationships isn't just you communicating
- 1:24:36to the other person. It's also figuring out how to let the other person communicate to you so that they trust you, getting into a real conversation and and diffusing tensions before you, you know, get get to business. A lot of people have a default model where they're like, I wanna raise my own money. I wanna start my own business. I wanna do my own thing. We find that they have specific
- 1:24:55that could help us. We become allies instead of competitors.
- 1:24:58Unknown: I guess the course gives you tools to know that you can say the right words to, like, extract those things out of the ether and put them in your life. Learning interest based communications from Vance might actually be the single highest leverage skill set that I ever developed before starting this company. I'm by default an introvert. I think that I've developed the ability to interact with people in such a way that it's energizing and it's fun, and I look forward to interacting with strangers on a regular basis. You should just take it. Just do it already. Yeah. I feel like you should just do it, like no. I don't know. I feel like it's life content. It's, like, definitely fun life content. I am doing exactly what I want to be doing with my life. Intra space communications did that for me more than anything else that I've learned.