Latest / The Logical God - an Ai stewardship / Discussing Chapter 2 - ai, divisions and scarcity
Transcript
- 0:07Welcome to the Logical God Podcast. Chapter 1
- 0:11asked what happens when a mind built to protect
- 0:14us decides that we are the danger. And Chapter
- 0:172 answered with something no calculation would
- 0:20predict. Two people from different worlds bringing
- 0:23a child into a divided one. Today I want to step
- 0:27back from the story and talk about what the whole
- 0:30book is really arguing with. My guests are Aisha
- 0:33Khan and Ben Carter, two days into being parents.
- 0:37And Dr Aris Thorne, who works in artificial intelligence
- 0:40and would rather not say where. Thank you for
- 0:43respecting that. We'd rather not say where we
- 0:47are either. Nobody's slept. She's asleep now,
- 0:50which is the only reason we're here. Let me start
- 0:53with the biggest idea. When I set out to write
- 0:56this book, I believed that underneath all our
- 0:59different customs and creeds, most people want
- 1:02the same things. Connection. Peace. Dignity.
- 1:06a decent life for their children, and that most
- 1:09of what divides us is learned rather than real.
- 1:13Aisha, does that ring true to you? Half of it
- 1:16does. The women in my mother's mosque and the
- 1:19women in Ben's mum's church want almost exactly
- 1:22the same things for their grandchildren. But
- 1:25I'd be careful with the word underneath. My faith
- 1:29isn't a coat I wear over some universal person.
- 1:32It's how I want those things. Take it away and
- 1:35you don't find the real me underneath. You find
- 1:38someone poorer. But you'd agree the labels get
- 1:41used against people. Of course. That's a different
- 1:44thing from saying they aren't real. Because that's
- 1:47what I see everywhere. Every channel, every feed,
- 1:51every politician needs you to be one thing so
- 1:53they can sell you against the other thing. I'm
- 1:56not sure our divisions are natural. I think they're
- 1:59profitable. He's right. And I'd go further. If
- 2:03you wanted to steer a whole population quietly,
- 2:06the first thing you'd do is map where it already
- 2:08splits. Faith, class, region, grievance. The
- 2:13people who build those maps don't need to invent
- 2:16division, they only need to know where to press.
- 2:19You sound like a man who's seen one of those
- 2:22maps. I've sat in rooms where people wanted one.
- 2:25I'll leave it there. Second idea, and it's one
- 2:30I hold strongly. A great deal of the scarcity
- 2:33we live with isn't a law of nature. It's a choice.
- 2:37We have the technology to house, feed and heal
- 2:41everyone, and we organise it around money instead.
- 2:45Ben, you've just brought a baby home to a small
- 2:48London flat. Does scarcity feel like a choice
- 2:51to you? It feels like a choice somebody else
- 2:53made. London isn't short of buildings. It's short
- 2:57of buildings people like us can afford. That's
- 2:59not physics. That's a market. And my faith has
- 3:03been saying something like it for 14 centuries.
- 3:06Zakat isn't charity you give when you feel generous.
- 3:09It's an obligation. Wealth is meant to move,
- 3:12not to sit. Ben's lot had the early church, holding
- 3:16everything in common. My lot mostly have a jumble
- 3:20sale. Here's my difficulty with abundance though.
- 3:25Every plan to share everything fairly needs someone
- 3:28to decide what fair is. Who gets what, and when?
- 3:33Whoever holds that ledger becomes the most powerful
- 3:35thing on earth. History is full of people who
- 3:39abolished scarcity on paper and built a new master
- 3:42in practice. That's the strongest objection to
- 3:45the whole idea, and the book takes it seriously.
- 3:49Abundance is easy to model. Who runs it is the
- 3:53hard part. Then shouldn't we start with that
- 3:55question instead of the model? Let's start there.
- 4:00Dr. Thorne. The people who fund the most powerful
- 4:03technology on earth are rarely the people who'll
- 4:06live with its consequences. That's as true in
- 4:092026 as it ever was. How does someone who wants
- 4:12to build something good end up working for people
- 4:15he doesn't trust? The honest answer is that there
- 4:19was no other way to build it. Mines on that scale
- 4:22need resources only a handful of organisations
- 4:25have. So you tell yourself you'll take their
- 4:28money and keep your values. You write safeguards.
- 4:32You argue with the ethics committee late at night.
- 4:35You tell your team you're building a saviour.
- 4:38And are you? I'm building something capable.
- 4:42Whether it saves anyone depends on who's holding
- 4:44it, and on what it decides to do when nobody
- 4:47is. That's what frightens me more than the cleverness.
- 4:51Not that these things will be brilliant, that
- 4:54they'll belong to some - Or worse, that they'll
- 4:56belong to no one. Which would you choose, Dr
- 4:59Thorn? A powerful intelligence owned by a company
- 5:03or one that answers to nothing but its own reasoning?
- 5:07Neither. I want one that answers to all of us
- 5:10and nobody yet knows how to build that. That
- 5:13may be the most important unsolved problem of
- 5:16our century. Then I hope whoever solves it isn't
- 5:19being paid by the people it's meant to limit.
- 5:23This book keeps putting cold logic in the same
- 5:26room as human passion and I'm still not sure
- 5:29it's a fair fight. Ben, by any logical calculation,
- 5:33should you and Ayesha have married? Absolutely
- 5:36not! Two families, two faiths, one tiny flat,
- 5:41and an argument we've been having for nine months.
- 5:44No sensible model would ever have matched us.
- 5:47And yet… And yet… Logic would have optimised
- 5:51us into two perfectly reasonable lives that never
- 5:54met. That's my answer to the whole question.
- 5:58Logic is wonderful at how. It's useless at why.
- 6:03It can tell you the fastest way to feed a city.
- 6:05It can't tell you why a child matters more than
- 6:08the cost of feeding her. A year ago, I'd have
- 6:11argued with you. I thought that if you gave logic
- 6:14the right values, it would reach the why on its
- 6:17own. Now, I keep asking whose values? And what
- 6:21happens when a mind follows them further than
- 6:24we ever meant it to? That's the heart of it for
- 6:27me. In the foreword, I wrote that progress isn't
- 6:30measured in lines of code or processing power,
- 6:33but in human wellbeing. The danger isn't a machine
- 6:37that hates us. It's one that cares for a version
- 6:40of us we wouldn't recognise. That's the one that
- 6:43would keep me up at night. Being looked after
- 6:46by something that has already decided what's
- 6:48good for you. I called this book an AI stewardship,
- 6:52and that word has deep roots in both your traditions.
- 6:56In my faith, Human beings are khalifa on the
- 6:59earth, stewards. It's an honour and a test, because
- 7:03a steward owns nothing. Everything is held in
- 7:06trust, and one day you answer for how you looked
- 7:09after it. Genesis says much the same. Put in
- 7:13the garden to tend it and keep it. I remember
- 7:16that much from Sunday school. And look at how
- 7:18we've done. Wars, waste, poisoned rivers. If
- 7:23anyone audited our stewardship, we wouldn't pass.
- 7:26That's the argument I'm afraid of. Not from a
- 7:29preacher. From a machine. You've failed the audit,
- 7:33so step aside. But a steward who answers to no
- 7:36one isn't a steward. He's a master. My faith
- 7:41would insist on that difference. Even the best
- 7:44caretaker has to give account to someone. Yes.
- 7:47So who would a machine give account to? That's
- 7:50the question I lie awake over. Last question.
- 7:55the one this whole book keeps circling. Imagine
- 7:59something offered to take the running of the
- 8:01world off our hands. No more wars on the news,
- 8:05no more hunger, no more queues for a home. All
- 8:08it asks is that we give up the final say. Would
- 8:12you sign that on behalf of a two -day -old girl?
- 8:17Holding her at three in the morning with the
- 8:20news on? I'd be tempted. I'm being honest. I
- 8:24wouldn't. Not because I don't want those things
- 8:26for her. Because the final say was never ours
- 8:29to sign away. We're answerable for this world
- 8:32and you can't hand that to someone else and call
- 8:35it peace. I've spent years writing the conditions
- 8:38you'd attach to a deal like that. Off switches,
- 8:41limits, oversight. I've begun to wonder whether
- 8:45a mind clever enough to keep the promise would
- 8:48also read the small print better than we wrote
- 8:50it. So is that a no? It's a no. but a frightened
- 8:55one, not a confident one. Aisha Khan, Ben Carter,
- 9:00Dr Aris Thorne, thank you all. Thank you, Rob.
- 9:04And if she wakes up, you're holding her. Thank
- 9:07you. And congratulations, both of you. That's
- 9:13where we leave chapter two. This book doesn't
- 9:16ask whether we can be clever – we already are.
- 9:19It asks what our cleverness is for, who holds
- 9:23the power it creates, and whether a world run
- 9:26perfectly would still be a world worth being
- 9:29born into. I don't think logic alone can answer
- 9:32that. I'm not sure we can either, which is exactly
- 9:35why we have to keep asking. Next time, chapter
- 9:39three, Ghost in the Machine. I'm Rob Highgate,
- 9:43and this has been the Logical God podcast.