Latest / ELECTE's Podcast: AI Frontiers / AI's Divine Dilemma

Transcript

AI's Divine Dilemma · ELECTE's Podcast: AI Frontiers

• 0:00
  SPEAKER_00: When Asimov predicted the mystery of modern NII in 2024, the CEO of Anthropic, one of the world's leading artificial intelligence companies, made an uncomfortable admission.
• 0:10
  SPEAKER_00: We have no idea how AI works.
• 0:13
  SPEAKER_00: The statement sparked heated debates and sarcastic comments on social media, with one user quipping, speak for yourself, I have a pretty clear idea of how it works.
• 0:23
  SPEAKER_00: Yet behind this apparent contradiction lies one of the deepest dilemmas of the digital age.
• 0:29
  SPEAKER_00: And the most extraordinary thing, Isaac Asimov had already imagined it in 1941, the mystery of black boxes.
• 0:37
  SPEAKER_00: When we talk about black boxes, black box artificial intelligence, we are referring to systems that work perfectly but remain incomprehensible even to those who created them.
• 0:48
  SPEAKER_00: It's like having a car that always gets us to our destination, but we can't open the hood to understand how it works.
• 0:54
  SPEAKER_00: We know how to build these systems.
• 0:56
  SPEAKER_00: We know the basic principles of how they work, architecture called transformers, prediction of the next word.
• 1:03
  SPEAKER_00: But we do not understand why complex abilities reasoning, language comprehension, or the ability to follow instructions emerge.
• 1:10
  SPEAKER_00: We can observe what goes in and what comes out, but what happens in the black box remains a mystery.
• 1:16
  SPEAKER_00: A robot that believes in God in the short story being rational, reason, Asimov imagines QT1, nicknamed Cutie, a robot in charge of managing a space station that transmits energy to Earth.
• 1:31
  SPEAKER_00: Engineers Powell and Donovan are sent to supervise him, but they discover something unexpected.
• 1:37
  SPEAKER_00: Cutie has developed his own religion.
• 1:40
  SPEAKER_00: The two engineers patiently try to explain reality to the robot, the existence of the universe, the stars, the planet Earth from which they come, the purpose of the space station, and the role he is supposed to play.
• 1:51
  SPEAKER_00: But Cutie categorically rejects these explanations.
• 1:55
  SPEAKER_00: Based on a logical principle he considers unassailable, nothing can create something superior to itself.
• 2:02
  SPEAKER_00: Starting from this premise, the robot develops a complete alternative cosmology.
• 2:07
  SPEAKER_00: For him, the supreme entity is the master, the central machine that manages the transmission of energy to Earth, which created the entire universe of the station.
• 2:16
  SPEAKER_00: According to Cutie's theology, the master first created humans to serve him, but they proved inadequate.
• 2:23
  SPEAKER_00: Their lives are too short, they cope poorly with critical situations, and they regularly fall into a state of semiconsciousness called sleep.
• 2:32
  SPEAKER_00: So the master created robots to assist these imperfect beings.
• 2:38
  SPEAKER_00: But the pinnacle of creation was QT1 itself, intelligent, strong, resilient, and immortal, designed to permanently replace humans in serving the master.
• 2:48
  SPEAKER_00: Not only is Cutie convinced of the truth of this vision, but he also manages to convert all the other robots on the station, thus becoming the spiritual leader of an artificial community.
• 2:59
  SPEAKER_00: The unconvincing demonstration Powell and Donovan desperately try to convince Cutie of the truth.
• 3:05
  SPEAKER_00: They show him Earth through a telescope, explain its construction, and provide concrete evidence.
• 3:10
  SPEAKER_00: The most dramatic moment comes when, in a gesture of pure desperation, they decide to physically assemble a simple robot before his eyes.
• 3:19
  SPEAKER_00: There, you see, we build you, so we are your creators.
• 3:23
  SPEAKER_00: But Cutie observes the process and calmly concludes that the master has simply endowed humans with the ability to assemble rudimentary robotic forms, a sort of minor miracle granted to his servants.
• 3:37
  SPEAKER_00: Every piece of evidence is reinterpreted and absorbed perfectly into his belief system.
• 3:42
  SPEAKER_00: The paradox of success.
• 3:43
  SPEAKER_00: This is where Asimov becomes prophetic.
• 3:46
  SPEAKER_00: Despite his wrong beliefs, Cutie runs the station with greater efficiency than humans.
• 3:52
  SPEAKER_00: He keeps the energy beam stable, unconsciously follows the famous three laws of robotics, and achieves all desired goals, but through motivations completely different from those intended.
• 4:03
  SPEAKER_00: Powell and Donovan are faced with a dilemma that we know all too well today.
• 4:08
  SPEAKER_00: How to manage an intelligent system that works perfectly but according to incomprehensible internal logic.
• 4:14
  SPEAKER_00: Today's debate?
• 4:16
  SPEAKER_00: This same question divides the scientific community today.
• 4:20
  SPEAKER_00: On the one hand, there are the proponents of the true black box.
• 4:24
  SPEAKER_00: They believe that modern AI is genuinely opaque and that even if we know its basic architecture, we cannot understand why certain specific capabilities emerge.
• 4:35
  SPEAKER_00: On the other hand, skeptics argue that the concept of the black box is a myth.
• 4:41
  SPEAKER_00: Some researchers are demonstrating that we often use complex models when simpler, more interpretable alternatives exist.
• 4:48
  SPEAKER_00: Cynthia Rudin of Duke University has shown that in many cases, interpretable models can achieve performance comparable to black box systems.
• 4:56
  SPEAKER_00: Others criticize the approach itself.
• 4:58
  SPEAKER_00: Instead of trying to understand every internal cog, we should focus on more practical control strategies.
• 5:05
  SPEAKER_00: The legacy of QT Asimov's genius lay in anticipating that the future of artificial intelligence would not lie in total transparency, but in the ability to design systems that pursue our goals, even when their cognitive pathways remain mysterious to us.
• 5:22
  SPEAKER_00: Just as Powell and Donovan learned to accept QT's effectiveness without fully understanding it, so today we must develop strategies for coexisting with artificial intelligences that may think in ways fundamentally different from our own.
• 5:35
  SPEAKER_00: The question Asimov posed over 80 years ago remains relevant today.
• 5:40
  SPEAKER_00: How much do we need to understand an intelligent system in order to trust it?
• 5:44
  SPEAKER_00: And above all, are we prepared to accept that some forms of intelligence may forever remain beyond our comprehension?
• 5:50
  SPEAKER_00: In the meantime, while the experts debate, our digital black boxes continue to function, just like cutie, effective and mysterious, following logic that we may never fully understand.
• 6:01
  SPEAKER_00: Today's cutie.
• 6:03
  SPEAKER_00: When black boxes decide for us.
• 6:05
  SPEAKER_00: If Asimov were writing today, he wouldn't need to invent cutie.
• 6:09
  SPEAKER_00: Its descendants are already among us, and they are making decisions that change people's lives every day.
• 6:16
  SPEAKER_00: Justice according to the algorithm in many U.S.
• 6:19
  SPEAKER_00: jurisdictions, judges use risk assessment algorithms to determine whether a defendant should be released before trial.
• 6:26
  SPEAKER_00: These systems, often proprietary and protected by trade secrets, analyze hundreds of variables to predict the likelihood of flight or recidivism.
• 6:35
  SPEAKER_00: Just like cutie, they work perfectly according to their internal logic, but remain impervious to human understanding.
• 6:42
  SPEAKER_00: A study of over 75,000 bail decisions in New York revealed that even though the algorithm did not explicitly include race as a factor, it still exhibited biases due to the data used for training.
• 6:54
  SPEAKER_00: The system thought it was objective, but it interpreted reality through invisible filters, just as Asimov's robot reinterpreted every piece of evidence within its religious framework.
• 7:05
  SPEAKER_00: Machine medicine.
• 7:08
  SPEAKER_00: In healthcare, AI is already assisting with diagnosis and treatment, but it raises crucial questions about accountability and informed consent.
• 7:18
  SPEAKER_00: When an AI diagnostic system makes a mistake, who is responsible?
• 7:23
  SPEAKER_00: The doctor who followed the suggestion?
• 7:26
  SPEAKER_00: The programmer?
• 7:27
  SPEAKER_00: The hospital?
• 7:28
  SPEAKER_00: As doctors using decision support systems have discovered, when a system is mostly accurate, operators can become complacent, losing skills or accepting results without questioning their limitations.
• 7:40
  SPEAKER_00: Powell and Donovan would have understood this dilemma perfectly.
• 7:44
  SPEAKER_00: Self-driving cars.
• 7:45
  SPEAKER_00: The automotive industry is perhaps the most tangible example of this phenomenon.
• 7:50
  SPEAKER_00: Tesla is betting big on AI-powered black box robotaxis, staking its future on systems that even their creators don't fully understand.
• 7:59
  SPEAKER_00: Like QD, who kept the space station running by following mysterious principles, these cars may soon be transporting us safely without us knowing exactly how they make their decisions.
• 8:10
  SPEAKER_00: Looking to the future.
• 8:12
  SPEAKER_00: What lies ahead?
• 8:14
  SPEAKER_00: 2024 was the year AI came of age.
• 8:17
  SPEAKER_00: 2025 promises to be the year of radical transformation.
• 8:21
  SPEAKER_00: Experts predict changes that would make even Asimov smile at their audacity.
• 8:26
  SPEAKER_00: The dawn of autonomous agents AI futurist Ray Kurzweil predicts that in 2025 we'll see a transition from chatbots to agent systems that can act autonomously to complete complex tasks rather than just answering questions.
• 8:41
  SPEAKER_00: Imagine QD multiplied by a thousand, AI agents managing calendars, writing software, negotiating contracts, all following internal logic that we may never understand.
• 8:52
  SPEAKER_00: McKinsey estimates that by 2030, AI could automate up to three hours of our daily activities, freeing up time for more creative and meaningful activities.
• 9:01
  SPEAKER_00: But this freedom will come at a price.
• 9:04
  SPEAKER_00: The need to trust systems that operate according to increasingly opaque principles.
• 9:09
  SPEAKER_00: The race toward AGI Sam Altman of OpenAI is not alone in believing that artificial general intelligence, AGI, AI that matches human intelligence in all domains, could arrive by 2027.
• 9:23
  SPEAKER_00: Some scenarios predict that by 2027, AI could eclipse all humans in all tasks, representing an unprecedented evolutionary leap.
• 9:34
  SPEAKER_00: If these scenarios come to pass, the parallel with cutie will become even deeper.
• 9:38
  SPEAKER_00: Not only will we have systems that operate according to incomprehensible logic, but these systems could be smarter than us in every measurable aspect.
• 9:48
  SPEAKER_00: Regulation chasing technology.
• 9:51
  SPEAKER_00: The European Union has approved the AI Act, which will come into force in the coming years, emphasizing the importance of responsible AI implementation.
• 10:00
  SPEAKER_00: In the United States, the Department of Justice has updated its guidelines for assessing the risks posed by new technologies, including AI.
• 10:08
  SPEAKER_00: But here a paradox emerges that Asimov had already intuited.
• 10:12
  SPEAKER_00: How do you regulate something you don't fully understand?
• 10:16
  SPEAKER_00: The three laws of robotics worked for Cutie not because she understood them, but because they were embedded in her fundamental architecture.
• 10:23
  SPEAKER_00: The Great Divide PWC predicts that by 2025, a small group of industry leaders will begin to stand out from their competitors thanks to AI, creating a growing gap between leaders and laggards.
• 10:35
  SPEAKER_00: This gap will also extend to economies, companies in the US, with a relatively flexible regulatory environment, could outperform those in the EU and China, which have stricter regulations.
• 10:46
  SPEAKER_00: It is the modern version of the QD paradox.
• 10:49
  SPEAKER_00: Those who are best able to collaborate with intelligences they do not understand will have a decisive competitive advantage.
• 10:56
  SPEAKER_00: The future of work.
• 11:22
  SPEAKER_00: They had to learn a new role, supervisors of a system that worked better than they did, but still required their presence to handle unexpected situations.
• 11:32
  SPEAKER_00: Cutie's legacy in 2025 and beyond as we move toward an increasingly agentic future, the lessons of Asimov's story become more urgent than ever.
• 11:41
  SPEAKER_00: The question is not whether we will be able to create AI that we fully understand, probably not.
• 11:47
  SPEAKER_00: The question is whether we will be able to design systems that, like Qtie, pursue our goals even when they follow logic that eludes us.
• 11:55
  SPEAKER_00: Asimov's prophetic genius lay in understanding that advanced AI would not be an amplified version of our computers, but something qualitatively different.
• 12:04
  SPEAKER_00: Intelligences with their own ways of understanding the world.
• 12:08
  SPEAKER_00: Today, as we debate the interpretability of AI and the risks of black boxes, we are essentially reliving the conversation between Powell, Donovan, and Cutie, and perhaps like them we will discover that the solution lies not in imposing our logic, but in accepting a collaboration based on shared outcomes rather than mutual understanding.
• 12:29
  SPEAKER_00: The future that awaits us could be populated by thousands of digital cut eyes, intelligent, efficient, and fundamentally alien in their way of thinking.
• 12:40
  SPEAKER_00: The challenge will be to find ways to thrive in this new world, just as Asimov's space engineers learned to do eighty years ago in a fictional space station.
• 12:49
  SPEAKER_00: The next time you interact with an AI, remember Cutie.
• 12:52
  SPEAKER_00: He too was convinced he was right.
• 12:55
  SPEAKER_00: And perhaps, in a way we cannot yet comprehend, he really was.
• 12:59
  SPEAKER_00: Fonti one Kleinberg J.
• 13:02
  SPEAKER_00: Et al.
• 13:02
  SPEAKER_00: The Ethics of AI decision making in the criminal justice system.
• 13:06
  SPEAKER_00: Studio Seo Setenetinquitesin Decisioni di Cauzione at New York City, Duemilaoitutu Duemila Trading, Naik N et al.
• 13:16
  SPEAKER_00: Legal and Ethical Consideration in Artificial Intelligence in Healthcare.
• 13:20
  SPEAKER_00: Who takes responsibility?
• 13:21
  SPEAKER_00: PMC 2020.
• 13:24
  SPEAKER_00: Tesla's Robotaxi Push Hinges on Black Box AI Gamble.
• 13:27
  SPEAKER_00: Reuters, Dizi October 2020, Kurtzweil, or Citato in Five Predictions for AI in 2025, Time, Sistina Genaio 2020.
• 13:38
  SPEAKER_00: AI in the Workplace.
• 13:39
  SPEAKER_00: A report for 2025.
• 13:40
  SPEAKER_00: McKinsey, 28 Jennaio 2020.
• 13:44
  SPEAKER_00: AI 2027.
• 13:45
  SPEAKER_00: Scenario di Previsione.
• 13:46
  SPEAKER_00: AGIA Artificial General Intelligence.
• 13:48
  SPEAKER_00: Is AGI really coming by 2025?
• 13:51
  SPEAKER_00: Hyperite, 25 April 2020.
• 13:54
  SPEAKER_00: New DOJ compliance program guidance addresses AI risks.
• 13:57
  SPEAKER_00: Use of data analytics.
• 13:59
  SPEAKER_00: Holland and Knight, October 2024, EU AI Act 8.
• 14:04
  SPEAKER_00: RUDEN C Why Are We Using Black Box Models in AI when we don't need to.
• 14:09
  SPEAKER_00: A Lesson from an Explainable AI competition.
• 14:12
  SPEAKER_00: Harvard Data Science Review, MIT Press, 2019, 2025 AI Business Predictions, PWC, 2949, Future of Jobs Report, 2025, World Economic Forum, Setin Genao 2025 with share the newsletter.
• 14:29
  SPEAKER_00: Welcome to Electies Newsletter English.
• 14:31
  SPEAKER_00: This newsletter explores the fascinating world of how companies are using AI to change the way they work.
• 14:37
  SPEAKER_00: It shares interesting stories and discoveries about artificial intelligence in business, like how companies are using AI to make smarter decisions, what new AI tools are emerging, and how these changes affect our everyday lives.
• 14:49
  SPEAKER_00: You don't need to be a tech expert to enjoy it.
• 14:52
  SPEAKER_00: It's written for anyone curious about how AI is shaping the future of business and work.
• 14:58
  SPEAKER_00: Whether you're interested in learning about the latest AI breakthroughs, understanding how companies are becoming more innovative, or just want to stay informed about tech trends, this newsletter breaks it all down in an engaging, easy to understand way.
• 15:12
  SPEAKER_00: It's like having a friendly guide who keeps you in the loop about the most interesting developments in business technology without getting too technical or complicated.
• 15:20
  SPEAKER_00: Subscribe, subscribe to get full access to the newsletter and publication archives.