Latest / The Road to Accountable AI / Jessica Lennard: AI Regulation as Part of a Growth Agenda

Transcript

Jessica Lennard: AI Regulation as Part of a Growth Agenda · The Road to Accountable AI

• 0:01
  Jessica, thank you so much for joining me on the road to Accountable AI.
• 0:05
  Hi Kevin, how are you?
• 0:09
  All right.
• 0:12
  It just glitched for a second.
• 0:13
  me, let me just do that one more time for some reason it, it just froze for a sec, but probably just on my end.
• 0:18
  But this, this records each one separately.
• 0:19
  Let me just do one.
• 0:23
  Yeah, for some reason I've got some sort of...
• 0:24
  Yeah, it'll be fine.
• 0:25
  There's just some sort of...
• 0:29
  Jessica, welcome.
• 0:29
  Thank you so much for joining me on the road to accountable AI.
• 0:33
  Hi Kevin, great to be with you.
• 0:36
  First, for those who aren't in the UK or familiar with the system there, what exactly is the Competition and Markets Authority and what does it have to do with AI policy?
• 0:47
  That's a very good question.
• 0:49
  Telling me all your listeners don't already know who the CMA is?
• 0:52
  Terrible.
• 0:54
  So we are the UK Competition and Markets Authority.
• 0:57
  We are the primary competition and consumer protection authority for the UK.
• 1:01
  So that's obviously a little different to the system you guys have in the US with the DOJ and the FTC.
• 1:06
  We are two for one.
• 1:10
  We are part of the UK government, but we have independent, evidence-led decision-making.
• 1:16
  Now, our mandate comes from the UK Parliament.
• 1:19
  There's a mandate for us to promote competition within and outside of the UK for the benefit of consumers.
• 1:27
  That's what the legislation says.
• 1:30
  And we have a very clear purpose as well, which is our sort of North Star as an organization.
• 1:34
  And that is to promote competitive markets and to tackle unfair behavior.
• 1:38
  And we do that for the benefit of people, businesses, and the UK economy.
• 1:44
  Now.
• 1:45
  I will talk a little bit about the kind of context in which we're doing that in the UK and then I'll come on to the question around AI.
• 1:52
  So we have a new government here in the UK, a new Labour government, and we are having a big, big conversation at the moment about growth in the UK, economic growth.
• 2:03
  We have a new national mission, which is a critical priority for the new government to drive that growth that we all want to see across our economy.
• 2:11
  Now, for the CMA, growth has been a core pillar of our strategy
• 2:15
  for the last couple of years.
• 2:17
  our incoming CEO and chair when they came in in early 2023 launched a new strategy for the CMA and productive and sustainable growth across the whole whole UK economy is a core
• 2:29
  pillar of that strategy.
• 2:31
  So that's really front and center of the way we're thinking about everything that we do at the moment.
• 2:35
  How can we drive that growth, the investment, the innovation, the productivity that we need in the UK economy right now?
• 2:43
  So let me kind of come on to how we're thinking about AI.
• 2:46
  So look, we are living, I think it's fair to say, in a state of permanent technology revolution these days.
• 2:52
  It's very exciting, very disruptive.
• 2:55
  And AI is really at the forefront of that.
• 2:58
  We are really enthusiastic at the CMA about the potential opportunities that that offers.
• 3:04
  We think you have to lean into that, right?
• 3:07
  Not just because it has to play a critical part in growth, but also because ultimately what it could lead to is greater prosperity, a transformation for the better in the way
• 3:18
  that we live and work, right?
• 3:20
  So we're very, very excited about that.
• 3:23
  Our role within that is to make sure that that opportunity is fully realized.
• 3:28
  Making sure that competition is foundational to that, right?
• 3:32
  We've seen time and again, know, history and evidence has shown us that competition can play a foundational role in that innovation, in that productivity, in driving that
• 3:40
  investment, know, unleashing that growth.
• 3:43
  So for us, that's really foundational to what we're trying to do in AI.
• 3:48
  So what can regulators actually do to promote a domestic AI ecosystem?
• 3:55
  I sense some skepticism in your tone, Kevin.
• 4:00
  So look, think firstly, there's a big picture piece to all of this, right?
• 4:04
  AI is an ecosystem.
• 4:06
  It's a big value chain.
• 4:08
  And, you know, different regulators will look at different pieces of that, but the big picture is very, very important, right?
• 4:13
  I think you've got to look upstream at the infrastructure.
• 4:16
  You know, what are the kind of, you know, big ticket pieces, the critical inputs we need to...
• 4:21
  build models.
• 4:23
  And then I think you've got to look downstream at that deployment and release layer and even below that, know, kind of talent skills, how technology diffuses across an economy,
• 4:33
  all of that is incredibly important.
• 4:34
  And there are different bits of regulation which might apply, you know, even things like planning, immigration, you know, utilities, it's all kind of got a role to play.
• 4:42
  So there's a big picture piece.
• 4:45
  I think if we're realistic about the UK playing a real role here, becoming a real global leader,
• 4:54
  I think we have to understand, and the CMA is very emphatic about this, that that means a role for companies of all shapes and sizes, right?
• 5:01
  From the largest players who've powered a huge amount of innovation and investment in this space, through to the scrappy startups and challenges, the specialist providers, and of
• 5:13
  course, that huge, fantastic, committed AI ecosystem of researchers and academics, ethicists.
• 5:20
  Everyone has got a part to play there.
• 5:24
  If I come back to the CMA and our role and our remit, is of course competition.
• 5:31
  Again, we think competition can be absolutely foundational to unlocking, unleashing these opportunities.
• 5:37
  And it's not just specific to AI.
• 5:40
  History and evidence over a very long time tell us that competition has the power to do this, to unlock that innovation and all those benefits from market.
• 5:50
  I'll give you just four ways in which that happens.
• 5:53
  The first is around bringing down barriers to entry and having a level playing field.
• 5:59
  If you're a business thinking about starting up or scaling up in a market, you need to know that you're able to do that in a fair way.
• 6:07
  You've got a fair shot at success, at that level playing field.
• 6:10
  If you're going to risk your capital, get into something, that level playing field is there.
• 6:15
  And of course, that matters for investors too.
• 6:18
  You've got to put your money where you think you're going to get a fair return.
• 6:22
  And that level playing field instills confidence in investors, I think, when they're making those bets.
• 6:28
  Secondly, it's in everybody's interests that the products and services we have are as good as they can possibly be.
• 6:36
  You want companies to succeed on the merits.
• 6:38
  You want there to be a continuous cycle of improvement.
• 6:41
  And competition is the fire to the feet of companies to make sure that they do that.
• 6:47
  Thirdly, and I think this is also very important, for the small minority of bad actors to be held accountable so that the vast majority of fair dealing businesses have confidence
• 6:59
  in that fair shot.
• 7:00
  That has to work, and that's also part of competition enforcement.
• 7:04
  And then finally, choice, right?
• 7:05
  Who doesn't like choice?
• 7:07
  You know, consumers and businesses, of course, it's important to have that choice, right?
• 7:13
  But again, you know, that diversity of choice, competition can underpin that, not just because it helps consumers and businesses, but also there's quite a fundamental point
• 7:24
  there around economic resilience.
• 7:26
  So a resilient economy, one that is able to withstand shocks and volatility and, know, goodness, that's definitely the
• 7:34
  world we live in these days is one in which you have diversity of supply.
• 7:38
  We saw that through COVID.
• 7:40
  We see it increasingly.
• 7:42
  So competition helps to prop up that diversity of supply so that you're not vulnerable to those single points of failure.
• 7:50
  I just want come back to kind of regulation outside of the CMA for a moment and make two points.
• 7:55
  think the first of those is, as I said at the beginning, there's lots of different areas of regulation that need to be involved here.
• 8:02
  This is a general purpose technology.
• 8:03
  It's going to impact every part of our society and economy.
• 8:07
  So join up is incredibly important.
• 8:09
  We'll come on to talk more about how that works in practice later on.
• 8:13
  And secondly, regulation should not be the grit in the system, right?
• 8:19
  In an innovation led industry like this, that's absolutely fatal, right?
• 8:23
  So you need to make sure you're designing it and considering it in ways which understand and take into account the way that innovation led fast moving industries like this work.
• 8:33
  So the new government actually here in the UK has just brought in something called the Regulatory Innovation Office.
• 8:38
  I think this is really exciting.
• 8:39
  It's a specific part of government set up to analyze regulation.
• 8:43
  in these sort of innovation led industries and try and work out where it can help and where it's hindering and address that.
• 8:49
  So I think that's very positive.
• 8:52
  Tell us about some of the specific AI issues that you're looking at right now or engaged with at CMA.
• 8:59
  So it's a big field, but I'll talk about just a couple.
• 9:04
  So there's a long running area of interest for us around algorithmic harms.
• 9:08
  We put out a big piece of research in 2021 on this.
• 9:13
  And you'll be familiar with many of these sorts of issues, right?
• 9:16
  So, you know, things like AI bias and discrimination, you know, that could be in price or it could be, you know, discrimination against access to certain products and services,
• 9:26
  exploitation of vulnerability, you know, and then things like tacit collusion, you know, how can models
• 9:33
  kind of play a part in that.
• 9:35
  So we continue to be very, very interested in scrutinize those sorts of areas of work.
• 9:39
  And we've looked in the last couple of years about things like online choice architecture, dark patterns.
• 9:45
  We're looking at how AI can be integrated into those and potentially make some of those harms more prevalent.
• 9:51
  There's a secondary which we're very excited about at the moment, which is the potential to
• 9:56
  to use AI for competition.
• 9:59
  So can we actually, for example, in an area which is really pressing for the UK government, public expenditure, can we use AI here?
• 10:09
  So we know that bid rigging is a very real risk in public procurement.
• 10:14
  Public procurement is obviously hundreds of billions of pounds worth from the public purse.
• 10:18
  And we know that if we're going to grow the UK economy, we need investment.
• 10:22
  So every penny matters.
• 10:25
  Last year alone, the CMA
• 10:26
  fine 10 construction companies, 60 million pounds across public and private sector contracts for bid rigging.
• 10:33
  So we know this is a risk.
• 10:36
  We're actually talking to the UK government at the moment about how, with better data sharing and analysis, we could actually use AI to potentially identify that sort of
• 10:46
  illegal activity.
• 10:47
  So that's obviously very exciting as well.
• 10:51
  I will come on then to foundation models.
• 10:54
  So for the last two years, this has been a big area of focus for us.
• 10:58
  We actually started tracking the market way before two years ago.
• 11:03
  We do kind of technology, horizon scanning and insights on a regular basis.
• 11:06
  And, you know, it was quite clear to us quite a long time ago that this was an area to keep an eye on.
• 11:12
  And we have done that.
• 11:14
  So we do kind of regular tracking and in-depth research into the market.
• 11:17
  We started to do a couple of years ago quite extensive stakeholder engagement in this space as well.
• 11:22
  So we talked to companies of all shapes and sizes all around the world.
• 11:26
  We talked to sister authorities and regulators.
• 11:30
  We talked to civil society, academics, researchers.
• 11:33
  We have some phenomenal folks in the UK, but we also talk all around the world, including with plenty of organizations in the US.
• 11:42
  And then we've
• 11:44
  put out two in-depth reports on this.
• 11:47
  The last one was April last year.
• 11:50
  So what did we find in all of that research and all of that stakeholder engagement?
• 11:55
  Firstly, we found enormous opportunities.
• 11:58
  And, as I say, the CMA is just very, very excited about the potential of these technologies.
• 12:02
  And that was writ large in the reports that we've published, right?
• 12:05
  That transformative potential revolutionized products and services, you know, really like efficiency and prosperity and just so many things you can see when you delve into the
• 12:16
  different use cases here.
• 12:18
  Farming, agriculture.
• 12:43
  towards positive outcomes.
• 12:45
  And that's been very much the frame for us.
• 12:47
  How can we use competition and consumer protection to guide markets towards those positive outcomes for UK businesses and consumers?
• 12:57
  That's our mandate.
• 12:59
  And how can we try and mitigate the emergence, the development of some of those risks?
• 13:07
  OK, sorry.
• 13:08
  Yeah, we might want to cut that question there, and then I'll move on to.
• 13:12
  OK.
• 13:14
  No, that's fine, we can cut it off at that point,
• 13:17
  for just one sec and let me just get my...
• 13:20
  Yeah, okay.
• 13:25
  Is it worth...
• 13:27
  Just a sec, sorry.
• 13:29
  Yeah, okay, so I finished that one there.
• 13:32
  The question, the 2b one we were gonna come on to about regulation kind of fits there.
• 13:37
  Do you wanna...
• 13:38
  thought you had taken that with the part you said at the end.
• 13:42
  If there's more you want to say, I'm happy to go back to that.
• 13:46
  let me pick up just then where I left off of that and say...
• 13:50
  Yeah, let me just, yeah, then why don't I ask you the question just to break it up a little bit, but then, yeah, then can go back to it.
• 13:56
  you can say, you know, how did you, so how then are you tackling what you found?
• 13:59
  Something like that.
• 14:01
  Because I've talked about the risks, so it kind of leads on from there a bit.
• 14:06
  So, right, but this is back to the, to the specifically about regulation, so.
• 14:10
  Yeah, okay, sure.
• 14:12
  Okay.
• 14:14
  Okay.
• 14:15
  issues that we either we've been looking at.
• 14:18
  So how exactly are you tackling those challenges?
• 14:23
  Well, I think it's interesting.
• 14:25
  Again, if I come back to what not to do.
• 14:28
  in some senses, right?
• 14:30
  You know, we hear this from companies all the time and I worked in the corporate world for the vast majority of my career before coming to the CMA.
• 14:40
  So I know this to be true, that poorly designed, heavy handed, kind of overbearing regulation really does have the potential to stymie innovation and growth.
• 14:50
  And that is not the outcome that the CMA is looking for at all, quite the opposite.
• 14:55
  So the approach that we've taken after doing that research
• 14:58
  and publishing those reports that I mentioned a moment ago is a principles-based approach.
• 15:05
  So we've got six principles that we developed in collaboration with that big stakeholder group that I mentioned, consulted on those a lot, and we published the final version of
• 15:15
  those with our April report.
• 15:17
  So those I can run down for you a little bit.
• 15:20
  There's a lot of detail about these available, but I'll give you a quick kind of top line.
• 15:24
  So the first one is access.
• 15:26
  So ongoing and ready access to the critical inputs that we know are required to build, develop these models.
• 15:32
  So things like data, things like compute, things like access to talent.
• 15:38
  The second one is diversity.
• 15:39
  So we spoke about diversity a moment ago.
• 15:42
  You know, the benefits of that diversity in the models that are available, right?
• 15:46
  Open source, cloud source.
• 15:47
  different capabilities.
• 15:49
  We want to see that diversity maintained.
• 15:52
  And that leads me into the third principle, which is choice.
• 15:55
  You we want the end users and the business customers to have real choice here, not just of the different models, but you know, being able to switch across different ecosystems.
• 16:05
  We don't want to see any kind of lock in there at all.
• 16:08
  The fourth one is fair dealing.
• 16:10
  So it's incredibly important in these ecosystems, right?
• 16:14
  Where lots of companies of different shapes and sizes have relationships with one another.
• 16:18
  And some of those smaller companies really depend on those big ecosystems that there is a principle of fair dealing there.
• 16:25
  We don't want to be seeing anti-competitive behavior like anti-competitive tying, bundling, self-preferencing, that kind of lock-in.
• 16:36
  And then two which are slightly different, so transparency and accountability.
• 16:42
  Now, transparency by that we really mean, do end users and business customers have enough information to understand the risks and the limitations of these models?
• 16:52
  And accountability, this is really on the firms developing and deploying to make sure that they're behaving responsibly, that they're accountable, and that they're upholding that
• 17:01
  trust which we know is so incredibly important in this space.
• 17:06
  That's kind of the approach that we've taken, not the heavy-handed regulation, but a principles-based approach.
• 17:12
  And we've been working with that ecosystem on these principles since we published them.
• 17:17
  And I have to say the response has been great.
• 17:19
  We've been urging companies to embed these into their business practices.
• 17:23
  And one of the largest firms, who shall remain nameless, told us recently they thought these principles were the best thing to come out of an antitrust authority last year.
• 17:32
  So we'll take that.
• 17:35
  Fantastic.
• 17:37
  You talked very powerfully earlier about the value of competition in AI, but least to date what we've seen, especially for foundation models, is a great deal of concentration really
• 17:47
  at every layer of the stack.
• 17:48
  So is, is there a viable pathway towards more competition?
• 17:53
  I mean, I'm going to say yes, because we would be quite an unambitious competition authority if we had a different answer, but it happens to be true, I think.
• 18:01
  I mean, again, let's kind of look down the stack a bit.
• 18:04
  So in that, you know, those critical inputs that I talked about a moment ago, I think it's very fair to say that the largest companies are very well positioned here.
• 18:13
  You know, they have extremely deep pockets, which is what some of these sort of big ticket items require.
• 18:20
  And I think it's also important to recognize the contribution they've made here, actually, you know, to R &D, to investment, to talent.
• 18:28
  You know, they've been absolute engines of that stuff.
• 18:33
  So, you know, that's, think, very important to recognize.
• 18:35
  Does that mean there is not also a role for the smaller players?
• 18:38
  No, I think very, very much there is.
• 18:42
  Right.
• 18:42
  And it's also the CMA's job to make sure that that materializes.
• 18:46
  And I think that's I think it's very, you know, when you look at the last couple of years,
• 18:50
  right, the sort of curve jumping innovation we've seen.
• 18:53
  Some of the most innovative and capable models have actually come from the smaller players, models that are now becoming quite quickly household names, Claude, Perplexity,
• 19:02
  OpenAI, even my mom knows now what Perplexity is.
• 19:06
  So I make sure she's quite tech savvy.
• 19:10
  I think what that kind of shows you is that there really is kind of room for everybody here as long as we do keep in mind and really try to take seriously the principles that
• 19:20
  I just mentioned.
• 19:22
  Now, of course, competition is what underpins the sustainability of what I've just described, right?
• 19:28
  That kind of diversity in the ecosystem and that healthy tension that keeps companies competing with one another, right?
• 19:36
  The large ones with one another, and you do see that increasingly in this space too, as well as the smaller ones.
• 19:42
  So our job is very much to try and safeguard and enhance that, right?
• 19:49
  I think there is also...
• 19:50
  a layer down in the deployment and release layer that I'll come to talk a little bit more about competition there when I talk about the new digital markets competition and
• 20:00
  consumers act in the UK.
• 20:03
  But I do also just want to sort of come back a bit to the question of how is this possible?
• 20:08
  How are we going to maintain these things?
• 20:10
  And a piece I talked about a moment ago in terms of regulation.
• 20:14
  if we are able to keep moving in the right direction, to keep this diversity, to keep this kind of competitive rivalry going.
• 20:24
  What that kind of helps you avoid is needing to unpick some of this stuff later on down the line when harms have potentially become really entrenched.
• 20:33
  So early action, working together to do that can actually help avoid some of the sort of more disruptive type of interventions, right?
• 20:42
  The sort of regulation that we know companies don't want layered on top of yet more regulation.
• 20:48
  So we think there's a very positive way to move forward as an ecosystem.
• 20:54
  on all of this and hopefully prevent those problems from becoming entrenched and requiring more costly, more disruptive intervention later on.
• 21:04
  How do you develop the kinds of internal capacity and expertise though that you need to address such a technologically sophisticated area?
• 21:13
  It's a very, very good question.
• 21:14
  And again, you know, coming from the private sector, I've been astonished at how well the CMA does this.
• 21:21
  You know, they really did get ahead of the game in doing this.
• 21:25
  So in 2019, we set up our data technology and insights unit.
• 21:29
  And this is now an 80 strong multidisciplinary cross CMA function.
• 21:36
  It's absolutely fantastic.
• 21:37
  We've got data scientists, data engineers, e-discovery, forensics, behavioral scientists, and of
• 21:45
  know, increasingly lawyers and economists and policy folk as well, kind of, you know, all really embedded in this.
• 21:50
  So it's a fantastic capability.
• 21:53
  I'll say 80 again, just in case any of your listeners miss her and thought I said 800 or 8000.
• 22:00
  But you know, nonetheless, 80, I think puts us really at the forefront of these sort of capabilities for comparable authorities around the world.
• 22:07
  And it is incredibly important to have that right, you know, these are complicated, fast moving markets.
• 22:13
  So the onus is
• 22:14
  on us to make sure we really know what we're doing in this space.
• 22:18
  Now, it's not enough for us just to be doing that internally.
• 22:21
  The second piece that I would really emphasize is you don't learn unless you listen with something as technical and complicated as this.
• 22:28
  So that stakeholder engagement I've been talking about is really important.
• 22:32
  So Sarah Cardell, when she came in as CEO, she's made a very, very conscious push for the CMA to be really listening, engaging more than we have ever engaged with companies.
• 22:43
  We have a much more open door policy now for companies of all shapes and sizes to come and talk to us, explain their business models, understand us and our processes.
• 22:52
  And I would really urge companies to do that, actually.
• 22:55
  That's something we're very, committed to.
• 22:58
  So that listening and engaging.
• 23:00
  Also, we've got kind of, know,
• 23:02
  experience here which serves us in very good stead.
• 23:05
  So the work we've done around mobile ecosystems, around digital advertising, around cloud, online choice architecture, I talked about dark patterns.
• 23:14
  Some of this is market studies and some of it is really in-depth investigation, some is research, but there's a really rich kind of body of expertise and experience that has been
• 23:24
  built up over quite a significant number of years now, which we bring to bear when we look at things like AI.
• 23:34
  Are there any open investigations or enforcement proceedings in the US, for example, the Federal Trade Commission has an investigation ongoing of open AI?
• 23:43
  Is there anything similar happening in the UK?
• 23:46
  So we've thought very carefully across what we call our toolkit, the sort of suite of our powers.
• 23:52
  And it does work a little differently here than it does in the US.
• 23:55
  So we've kind of thought across the suite of what we have available to us.
• 23:59
  So I'll give you kind of a bit of a rundown of what we've been doing and thinking about.
• 24:04
  So firstly, we've been doing the research and the reports that I mentioned earlier and that kind of ecosystem engagement.
• 24:10
  We're looking at AI through the lens of our markets work.
• 24:13
  So we have this quite cool tool here in the UK called a market investigation.
• 24:16
  This is a really in-depth look at a market led by an internal, sorry, an independent group of experts.
• 24:24
  This is really forensic evidence led process.
• 24:28
  So we have our cloud market investigation open at the moment.
• 24:32
  And we have said that we will as part of that be considering the impact of foundation models on competition in cloud.
• 24:40
  services.
• 24:41
  So that's kind of one way that we can look at these things.
• 24:44
  And yes, we have a mergers tool.
• 24:46
  And, and we've been kind of thinking about AI in the context of that as well.
• 24:50
  So just to sort of frame that a little bit and bring us back to what we were talking about earlier in terms of the CMA role.
• 24:56
  So again, you know, when we're looking at all of this in the round, we're thinking about what how can we as a competition authority unlock that opportunity of the AI of AI for the
• 25:08
  UK, right?
• 25:08
  How can how can competition under
• 25:10
  pin growth in these markets.
• 25:12
  And we're also thinking about that duty I talked about, which is given to us by Parliament, to promote competition within and outside of the UK for the benefit of
• 25:21
  consumers.
• 25:22
  So with both of those in mind, we have been taking a look at a handful of partnerships that have been taking place across the AI ecosystem between some of the largest players
• 25:35
  and some of those smaller players that I spoke about earlier.
• 25:39
  And you know, some of those deals are a little complex and a little opaque.
• 25:44
  It's not immediately obvious with some of them what's going on.
• 25:48
  we look at that with two questions in mind, which are based on how merger law works here in the UK.
• 25:55
  So the first of those is, do we have jurisdiction to look at the deal?
• 25:58
  Does it constitute a deal under UK merger law?
• 26:01
  And secondly, does it really raise competition concerns?
• 26:05
  Do we think there's likelihood of a substantial lessening of competition in the UK?
• 26:10
  So that's kind of the frame through which we've been looking at these deals.
• 26:14
  Now, when I say looking at them, what that tends to mean is we have a phase one process, which is really a sort of information and evidence gathering process that gives the
• 26:25
  parties themselves the opportunity to submit documents.
• 26:29
  And they do a lot.
• 26:31
  But also third parties, know, anyone can kind of submit evidence to this process.
• 26:36
  It will all be looked at in the round by experts within the CMA.
• 26:42
  So we've been running through this handful of cases in a, I think, a very timely and efficient way, looking at that evidence.
• 26:49
  And as we go, we've been really striving to give greater clarity.
• 26:55
  You know, we've been ourselves kind of hoping to get greater clarity around the sorts of deals that do and don't meet the two
• 27:01
  criteria that I spoke about earlier.
• 27:03
  And also, we've been publishing very fulsome decisions.
• 27:08
  Not every authority around the world publishes a full decision if it's a clearance, right?
• 27:12
  We do do that.
• 27:13
  So we've been really trying to unpack our thinking in there because we know how important it is for businesses, right, to have that clarity, especially investors.
• 27:22
  So we've been really trying to do that.
• 27:25
  And, and we've been actually publishing supplementary commentary on top just to just to try and
• 27:31
  just to try and be as transparent as we possibly can.
• 27:35
  And that's really the way that the phase one process is designed to work here in the UK.
• 27:39
  It's a little unfamiliar perhaps for folks across the pond.
• 27:43
  The other thing I would say just to put all of that into context is there are around 50,000 &A deals announced every year.
• 27:51
  Here in the UK, we took a look last year at 913 of those.
• 27:58
  54 we investigated.
• 28:01
  And one was blocked.
• 28:05
  Just one.
• 28:06
  So I think, you know, it's very fair to say that the way that we treat this is consciously proportionate.
• 28:12
  That's the way the legislation is designed.
• 28:14
  There's a very, very high bar.
• 28:15
  And that's certainly our attitude when we look at these things.
• 28:20
  What do you see as the major open issues or open questions right now for AI?
• 28:28
  So, you we've talked about the competition piece quite a lot.
• 28:34
  So let me sort of move away from that and talk about another couple of issues that I think, you know, should be on everybody's radar.
• 28:41
  So the first one of those is the other half of our remit, which is consumer protection.
• 28:45
  You know, this is this is very much in everyone's minds.
• 28:47
  I'm sure that it is with yours, given the name of your podcast.
• 28:52
  As I say, algorithmic harms have been, you know, something on our minds for some time.
• 28:57
  And, you know, the report that we put out in April also looked quite in depth at the propensity of AI to exacerbate those harms.
• 29:05
  Now, you know, we also know that AI has incredible potential to do fantastic
• 29:11
  things, right, for consumers.
• 29:14
  But I think we want to be thoughtful about those two principles I mentioned of the CMAs, transparency and accountability, particularly in this context.
• 29:23
  I think it's incredibly important.
• 29:26
  Secondly, I think AI safety is a big one, right, that, you know, we should talk more about.
• 29:34
  This is one which is kind of, you know,
• 29:37
  catapulted up the political agenda for good reasons in the last couple of years.
• 29:41
  And I think it's extremely important that we maintain the global momentum that we have now behind this.
• 29:51
  And then the other piece I would sort of add on a little bit is what I talked about at the beginning in terms of all of the different areas of regulation that need to work together
• 30:01
  here.
• 30:02
  So it's quite easy, I think, for all of us in AI to lose sight of the bigger picture
• 30:07
  But you hear a lot at the moment around energy, for example, and the importance of that within the AI ecosystem.
• 30:13
  We know that it's incredibly important that infrastructure and planning work in the right way in order to facilitate the growth of these industries.
• 30:20
  So there's a big suite of policy issues there.
• 30:26
  Absolutely.
• 30:28
  I'm going to skip the question about coordinating with other agencies just for time, if that's okay.
• 30:32
  Yeah, so we're just going.
• 30:33
  So I'll do the DMCCA one next.
• 30:42
  You mentioned earlier the DMCCA, the UK Digital Markets Competition and Consumers Act, which is different from the Digital Markets Act, the DMA in the European Union.
• 30:54
  So could you say a little bit more about how that legislation impacts your authority and ability to address these kinds of issues?
• 31:04
  It is different, it is different.
• 31:05
  And I think it's worth noting that, you know, whilst
• 31:10
  authorities all over the world are taking different approaches to this.
• 31:14
  Many of the principles are the same, right?
• 31:16
  I think there's been a broad acknowledgement that, you know, for an innovation-led, fast-paced markets like digital, the sort of regulation that we had for quite a long time
• 31:27
  just wasn't going to cut it, right?
• 31:30
  So different places around the world have been developing their own kind of responses to that.
• 31:35
  And the digital markets competition and consumer regime in the UK is ours.
• 31:40
  We like to
• 31:40
  think that it is a very, very well designed and unique piece of regulation.
• 31:47
  There's a few features which make it so, I'll talk to you about those again.
• 31:51
  coming back to the principle I described earlier about how competition can unleash and unlock growth and investment, this is also the basis for this piece of regulation.
• 32:03
  The idea here is to maximize the opportunities to grow a UK tech sector.
• 32:09
  All right.
• 32:10
  And that's incredibly exciting.
• 32:12
  So that should mean that opportunities for the largest companies remain, right?
• 32:17
  They play an incredibly important role in these digital markets.
• 32:20
  And, you know, that should remain, but it means that the CMA will also have an ability to protect and enhance opportunities for the smaller players, right?
• 32:29
  For those scrappy startups, for the challenges, right?
• 32:33
  To come in and have that fair shot that I talked about earlier.
• 32:37
  And it should also mean fantastic opportunities for consumers and business customers to get great choices and fair deals.
• 32:44
  So that's kind of the framing context for this.
• 32:47
  We're hoping it's going to be genuinely a new era in digital growth for the UK economy.
• 32:53
  So how is it going to do that exactly?
• 32:56
  So it is supposed to apply to only a very small number of the very largest firms.
• 33:04
  So those firms will have what's called strategic market status.
• 33:10
  So this is a bit legalistic, but effectively what it means is they will have a substantial and entrenched position in one or more digital markets in the UK.
• 33:20
  Now we haven't made any provisional decisions yet about where we're to focus those investigations.
• 33:26
  But what I can talk about a bit is the principles and the process underpinning the way that this regulation will work and why we think it's so special and why we think it should
• 33:35
  be extremely attractive actually to
• 33:37
  to businesses and investors in the way that it operates.
• 33:40
  So first of all, it's designed to be very tailored and bespoke.
• 33:44
  It's not a big sweeping, one size fits all piece of regulation.
• 33:48
  We think that's really, really important for the reasons that I've described earlier.
• 33:52
  Instead, what it allows us to do is really target specific homes with tailored solutions, working iteratively with the companies in a participative conversation that involves the
• 34:05
  whole ecosystem, a wide range of stakeholders, so that the interventions we're making really are targeted to exactly that problem.
• 34:13
  And it allows us to be quite iterative and bespoke in the way that we're doing it and very proportionate as well.
• 34:21
  This is a truly different approach to what I think we see in other pieces of equivalent regulation.
• 34:27
  And certainly, this is something that we think is going to be very attractive, actually, to businesses.
• 34:33
  And certainly, we hope to the consumers that will also benefit from all of this.
• 34:40
  Now, AI is a consideration within that.
• 34:43
  We've kind of talked about that a little bit.
• 34:46
  How that might work in practice, for example, is where AI is part of one of the critical inputs that we might look at in one of those digital activities.
• 34:57
  cloud, for example.
• 35:00
  Equally, in that deployment layer that I said I'd come back to when you're looking at things like mobile ecosystems, search, productivity software, these are all potential
• 35:09
  avenues for foundation models to be deployed and released across the economy.
• 35:14
  That is also something that we can look at through the lens of this regulation.
• 35:21
  Would you say that you've learned anything even before the DMCCA?
• 35:28
  Yeah, that's okay.
• 35:29
  That's okay.
• 35:32
  While you're doing that, I'm just going to check something very, very quickly.
• 35:35
  Yeah.
• 35:36
  then we're almost done.
• 35:37
  Just two more questions.
• 35:42
  Shoot, you know, I misspoke and I knew I misspoke when I said it.
• 35:48
  Yeah, I tell you what I'm going to do super quick.
• 35:50
  I'm going to just say at the end of what I was talking about mergers, I said, I'm going to step back for some context here.
• 35:59
  There are 50,000 deals, right?
• 36:01
  I'm just going to do that one little bit again if we can.
• 36:03
  Thank you so much.
• 36:07
  Damn lies and statistics.
• 36:09
  Right.
• 36:10
  Okay, let me just reverse for a second.
• 36:15
  Yes.
• 36:16
  Okay.
• 36:17
  I think it's also worth just sort of noting for context here that around 50,000 &A deals were announced last year.
• 36:26
  And the CMA looked at 913.
• 36:31
  Now 95 % of those didn't even proceed to an investigation, let alone an intervention of some kind.
• 36:37
  And in fact, just one was prohibited.
• 36:40
  So it's quite useful to keep those sort of figures in mind.
• 36:46
  Super, thank you.
• 36:48
  All right.
• 36:49
  And how do you want to, where do you want to go next?
• 36:51
  So I was just gonna ask you, what have you learned from, even pre-DMCCA, what have you learned from the experience trying to exercise oversight over the big platforms?
• 37:00
  God.
• 37:03
  If you don't, I mean if that doesn't sound right, we could, you know, we've got enough time.
• 37:06
  be sort of slightly encroaching on Will's territory there.
• 37:10
  That's fine.
• 37:10
  No, don't worry about it.
• 37:11
  We've got enough content.
• 37:13
  So why don't I just go on to the last one, which is the global piece.
• 37:16
  That's totally fine.
• 37:18
  Okay.
• 37:20
  Because yeah, no, we've got, mean, there's, this is more than enough time even without any things.
• 37:25
  Great, okay.
• 37:28
  So last question, the UK hosted a major high level AI safety summit in late 2023 that resulted in an international declaration signed by I think 28 different countries around
• 37:42
  AI policy.
• 37:44
  To what extent do you think there is potential going forward for truly global governance of this phenomenon given how global the technology is?
• 37:54
  Very good question.
• 37:55
  makes me feel a little tired when you ask it like that.
• 38:00
  In my previous job, I had a big glass wall.
• 38:04
  And on that glass wall, every time I found a new AI ethics or governance framework, I would just note it down and I ran out of wall really quite quickly.
• 38:13
  So, you when you think about kind of global harmonization, yes, it seems it seems a long way off and to an extent that there are good reasons for that, right?
• 38:22
  know, nations are sovereign in terms of the, you know, the legal frameworks that they have and the decisions that they take, you know.
• 38:30
  different countries are at different stages of technological development, have different social norms.
• 38:34
  So, you know, that I think is understandable and healthy.
• 38:39
  I think when you when you think about an issue like this, and you look at the sort of existential risks that were discussed at Bletchley and in those sorts of conversations, it
• 38:50
  is eminently important that we do have that sort of global consensus and global conversation.
• 38:56
  I think Bletchley was incredibly important in that.
• 38:58
  it's fantastic that that
• 39:00
  is continuing around the world.
• 39:03
  from a competition perspective, we're a really active part of our international community talking about these things.
• 39:10
  know, groups like the G7 just issued a communique last month on a commitment in this area.
• 39:18
  Equally, we put out a joint statement over the summer with the FTC, the DOJ and the European Commission around upholding competition and consumer protection in the AI space.
• 39:28
  So we can all be we can all be doing that and, you know, continuing to to kind of
• 39:33
  share best practice to support one another in terms of understanding and sharing the kind of capabilities and expertise that you need in this space.
• 39:43
  These are borderless markets, right?
• 39:46
  And we live in a very globally interconnected world.
• 39:49
  So those relationships are strong already.
• 39:51
  They've been getting stronger over the last several decades.
• 39:55
  And I think they will continue to strengthen around an issue like AI.
• 40:00
  I mean, it's interesting, we were talking earlier about the different approaches even to digital regulation being taken around the world.
• 40:08
  In the EU now they have a big AI act.
• 40:12
  In the US, I know it's kind of a bit of a fragmented picture.
• 40:15
  Last I heard California's got 32 AI laws of its own.
• 40:20
  And here in the UK, I say, we're, CMA is gonna take this principles-based approach.
• 40:25
  Government's approach is kind of look at this through the lens of sectorial regulation primarily, and then it has
• 40:30
  the AI safety work as a kind of different strand and it will be bringing forward an AI safety bill within this parliament.
• 40:39
  So all of these different approaches, I hope, add up to some alignment on the need for real action in this space.
• 40:46
  But true harmonization, think we may need to come back in a few years and do another podcast on that.
• 40:53
  Well, that's all right.
• 40:54
  Covered a lot and this is a very fast moving area.
• 40:58
  Jessica, really appreciate your taking the time to speak with me.
• 41:01
  Not at all.
• 41:02
  Thanks so much, Kevin.