Latest / The Road to Accountable AI / Adam Thierer: Where AI Regulation Can Go Wrong

Transcript

Adam Thierer: Where AI Regulation Can Go Wrong · The Road to Accountable AI

• 0:01
  Adam, welcome.
• 0:01
  Thanks so much for joining me.
• 0:03
  Thanks for having me.
• 0:05
  You, like me, have been in tech policy and involved in tech policy debates for a long time.
• 0:12
  To what extent is AI policy an extension of the kinds of controversies we've been having for decades on tech policy, or is it something new?
• 0:25
  It's both something old and something new, Kevin.
• 0:27
  I think we have seen many of the same debates in the field of ICT, information and communications technologies, for many, decades about the nature of our speech platforms.
• 0:39
  And we're seeing an extension of traditional concerns that have pervaded many types of communications fights in the past.
• 0:47
  That being said, AI is something a little bit more important.
• 0:52
  Thomas Edison was once asked a question about electricity in which he said, know, Mr.
• 0:57
  Edison, a journalist said, tell us about the field of electricity.
• 1:00
  And he corrected the journalist or whoever asked the question and says, it's not just a field, it's a field of fields.
• 1:06
  He says it's many different fields and sub components.
• 1:09
  Whatever one thinks about Edison's assessment of electricity markets.
• 1:12
  So all those years ago, that's absolutely true of artificial intelligence, right?
• 1:16
  There's just so many more layers to this.
• 1:19
  This is not just ICT now.
• 1:21
  We live in a world of Hal Varian had a piece in 2010 where he talked about, living in a world now of combinatorial innovation, where many different revolutions are coming
• 1:32
  together.
• 1:33
  And Perez had a paper about this many years ago, what Carlotta Perez and there's a new book by Jamie Metzel called Superconvergence about how many different revolutions and
• 1:43
  technological capabilities are coming together, all mostly driven by data science, machine learning, artificial intelligence.
• 1:51
  That makes this a bigger debate than the one that you and I have been covering for many years now.
• 1:57
  There are a lot more players, a lot more issues.
• 2:02
  And it's not really right to just say, tell me what you think about AI policy.
• 2:07
  You have to almost say AI and fill in the blank, AI and elections, AI and education, AI and health, AI and driverless cars, drones, military law enforcement.
• 2:17
  Then it begins to be a more sensible debate.
• 2:20
  But the problem is people are still talking about it in a more aggregate macro sense, and that's a very hard governance conversation.
• 2:28
  So are there areas of AI and fill in the blank that do call for government action at this point?
• 2:36
  Absolutely.
• 2:37
  And there actually is a lot more than people realize.
• 2:40
  I always try to make efforts to explain to people, we have 439 federal departments in our federal government, 2 .2 million workers at them, covering a whole wide swath of ground in
• 2:53
  many different fields and sectors.
• 2:55
  And AI is already regulated in, again, field of fields, and it's separate fields or sectors in very different ways.
• 3:03
  So I've spent many years focusing on artificial intelligence in the field of driving and flying and driverless cars and drones and the way that NHTSA looks at driverless cars or
• 3:16
  DMVs at the state level.
• 3:17
  And then at the federal level, how the FAA governs drones.
• 3:20
  These are autonomous systems.
• 3:22
  They're driven by machine learning, compute computational technologies.
• 3:26
  They're very different and they're very different than something that happens in other fields like another regulated one like healthcare.
• 3:31
  I just released a...
• 3:33
  paper last year with Arizona State University Law School looking at how the FDA is regulating AI ML enabled medical devices.
• 3:41
  The FDA, many people don't realize this, had their first major study on computerized medicine in 1981.
• 3:49
  So they've been looking at it a long time.
• 3:51
  And of course, we could go into the fields of FinTech and many others, and of course, law enforcement and military, and find examples of how governments and government agencies
• 4:00
  have been looking at or even regulating
• 4:03
  very specific concrete examples of AI.
• 4:06
  But that's very, very different.
• 4:08
  And it's an important distinction between that and the idea of sort of regulating AI at a general purpose level as a general purpose technology.
• 4:17
  That's a very different discussion.
• 4:18
  Now, that's not what we've not had that in America, just as we've not had that for computation in general or the internet in general.
• 4:24
  We've really been more sectoral about it with computing and the internet as well.
• 4:29
  And this is, think, the grand debate of our time.
• 4:31
  Like how do you go about AI governance?
• 4:33
  Do you go about it as AI in a macro broad based way?
• 4:39
  Or do you take a more targeted risk -based sectoral focused approach of a more sort of bottom up approach to it?
• 4:47
  And a lot of people don't like doing that ladder because it's messier, it's more technical.
• 4:52
  But I think A, we're already doing it and B, it's probably more pragmatic to come at AI governance in that way.
• 5:00
  Isn't there a tension though between that sectoral approach and the first thing you said, which is that there's this explosion of combinatorial innovation and AI is driving the
• 5:09
  field of fields across everything.
• 5:11
  Absolutely, that's a brilliant point because the question there is does technological convergence drive regulatory convergence?
• 5:18
  I often make this point in my writing about driverless car technology, which is that on one hand, a driverless car is something very new and different.
• 5:25
  It's a computer on wheels and therefore it should be regulated, some people say.
• 5:28
  Other people say, no, no, no, it's still got wheels and it goes down a road.
• 5:31
  It's a car and cars are regulated at many different layers, in fact, federal, state, municipal.
• 5:37
  And so I think this is going to be the challenge for us as a governance when we talk about governance going forward, which is, you know, when you have old sectors and new colliding,
• 5:47
  what gives?
• 5:48
  I've used the phrases in my past work of technologies or sectors that are quote unquote born free versus born into regulatory captivity.
• 5:57
  And, you know, if you're into 3D printing or virtual reality or something like that, you're kind of born free and you don't have an overarching law or regulatory edifice
• 6:05
  around you.
• 6:07
  But if you're a medical device maker or a car maker, you know, a drone maker, you are probably born into regulatory captivity.
• 6:14
  You're going to be pigeonholed into yesterday's analog era governance system, whether you like it or not.
• 6:20
  I'd like to think that those old systems can change and adapt to the new technological realities.
• 6:27
  But the problem of the so -called pacing problem haunts us at every juncture.
• 6:30
  The idea that technology moves very fast, sometimes even exponentially.
• 6:35
  And yet policy tends to evolve incrementally sometimes at best, especially in our legislative arena, which is, know, Kevin has been very, very dysfunctional when it comes
• 6:45
  to technology policy.
• 6:46
  I look at how many years we've been debating a national baseline privacy bill.
• 6:50
  Right.
• 6:50
  And look at how long it took to get, I mean, when was the last thing that, you know, in our lifetime that we could name like a major technology policy piece of regular it's would
• 6:59
  we go back to the telecom act or
• 7:02
  You and I are around for the cable act and the telecom act and gosh, it was the internet tax freedom act.
• 7:06
  But there's not been a lot of comprehensive technology policy since then.
• 7:11
  There's been incremental things, right?
• 7:13
  So this is a fundamental challenge is like how governments confront the pacing problem.
• 7:19
  Okay, so if comprehensive regulation is likely off the table or really challenging in the US and you find that problematic to do it across the board, how should policymakers think
• 7:31
  about this?
• 7:32
  What are the mechanisms to get even those sectoral regulators to do a better job of addressing the new technology?
• 7:38
  Yeah, so here's where we have to divide our governance conversation into layers, jurisdictional layers.
• 7:43
  We could talk about federal, state, even local, and then we could talk about international as well.
• 7:48
  And yeah, absolutely.
• 7:50
  So at the federal level, I think for better or for worse, Congress has largely checked out of the situation for the reasons I just identified.
• 7:58
  It's become almost a non -actor in the field of technology policy.
• 8:01
  I mean, there's a lot of huffing and puffing.
• 8:03
  There's a lot of jawbone in too and things like that.
• 8:07
  In reality, we don't get a lot of traction when we try to move to legislate at the federal level.
• 8:12
  Instead, it falls to the executive branch and different executive branch agencies to probably fill in a lot of these gaps.
• 8:20
  And for AI, a huge amount of this is being done in the form of executive orders and major statements from the White House, and then filling in of the gaps by individual regulatory
• 8:30
  agencies or
• 8:32
  Technology oriented oversight bodies, most specifically two within the Department of Commerce in the form of NTIN and NIST.
• 8:39
  And the centrality of NTIN NIST, especially NIST to the AI governance story, cannot be overstated.
• 8:45
  Every day, its importance grows in terms of being a governance coordinator, especially now that the Biden executive order passed along to NIST a new AI safety institute to stand up
• 8:58
  and to move forward with, even though I should just point out.
• 9:00
  Congress didn't authorize that.
• 9:01
  There was no AI Act passed that said, you we should have an AI safety institute in And NIST has no regulatory authority.
• 9:08
  So isn't that interesting from a perspective of a political scientist who covers governance and worries about like, a stickler for like the black letter of the law and APA
• 9:16
  processes and foe ability of things.
• 9:18
  We have sort of a very different emergent governance coming about through NIST that's more, far more informal.
• 9:25
  I've written articles about so -called soft law governance.
• 9:28
  of emerging technology becoming the dominant form of technological governance, especially for things like AI and machine learning.
• 9:36
  So that's where the high level governance of AI is coming in.
• 9:40
  NIST already has things like its AI RMF, the Risk Management Framework, which it always has one, also has one for privacy and cybersecurity.
• 9:48
  And then NTIA for many years has convened so -called multi -stakeholder processes and work to effectuate
• 9:54
  various types of best practices or industry guidances or frameworks.
• 10:00
  Those things continue to trickle out and they accelerated under the Obama administration.
• 10:04
  But then Trump continued them as well.
• 10:07
  Even though they were kind of reluctant to, they just basically picked up and said, we'll do more of that kind of thing.
• 10:12
  For example, on driverless cars under Trump, NHTSA continued to come out with driverless car frameworks that were versioned like software that the Obama administration had
• 10:21
  started.
• 10:21
  The Obama administration had
• 10:23
  driverless car guidance 1 .0.
• 10:25
  And then Trump had guidance 2 .0, 3 .0, 4 .0.
• 10:28
  It's really interesting how they're even versioning it like software, right?
• 10:31
  But these things were not formal government enactments.
• 10:34
  They were just sort of, in one case, it were a PowerPoint presentation.
• 10:37
  They weren't even a formal publication.
• 10:40
  That's a really interesting governance thing that we're monitoring now for AI.
• 10:45
  And that's the framework we're using.
• 10:46
  But at the same time, in sectors that have been traditionally historically heavily regulated,
• 10:53
  They are moving forward with very specific targeted rules for drones, driverless cars, fintech, medical devices, so on and so forth, and stretching their authority as far as
• 11:03
  they can.
• 11:04
  And we'll see how far that goes.
• 11:05
  And especially in age of post -chevron deference, major questions, there are open -ended questions about how far that governance regime could be stretched in the executive branch
• 11:15
  in the absence of congressional action.
• 11:17
  And all the wishful thinking in the world can't make Congress just all of a sudden just act and do something.
• 11:22
  we've got to get around those politics that prevent that.
• 11:25
  So that's the federal level picture.
• 11:27
  And if I could briefly jump to state, I mean, go ahead if you want to ask it.
• 11:31
  OK, sure.
• 11:31
  to get to state absolutely, but just, you you talked about the soft law and some of those initiatives like what the NIST is doing, the Commerce Department.
• 11:39
  What are the pros and cons of the US at the federal level addressing many AI issues predominantly through that modality?
• 11:47
  Yeah, absolutely.
• 11:48
  That's a great question.
• 11:49
  So it's funny because the positive is also a negative in a sense.
• 11:53
  The positive is that this is in some ways exactly the more agile, iterative, flexible kind of governance framework that is in line with modern technological realities.
• 12:03
  It's not static, one size fits all, one time governance that you don't set it and forget it is what I like to call it.
• 12:09
  That's not what's happening.
• 12:11
  mean, NIST and NTI has been much more creative than that in trying to adapt its documents, again, going back to the idea of versioning these things over time like their software
• 12:19
  themselves.
• 12:20
  And the FDA has been doing this in a form of iterative governance for AI and medical devices and so on.
• 12:26
  In one sense, that's great.
• 12:27
  On the other hand, it's really a little bit messy to the point of knowing, is this really in line with the rule of law and accountability and like,
• 12:38
  procedures that we depend upon in a constitutional republic of saying, you should go buy the book.
• 12:43
  You should have an NPRM that's in the federal register and that clearly is citing statutory authorization.
• 12:50
  So I got to be honest with you, Kevin.
• 12:52
  I'm a bit conflicted because I don't want set it and forget it one time governance if it means that it holds back important innovation or doesn't address real time risks.
• 13:04
  At the same time,
• 13:05
  There is a little bit of a make it up as you go along element to AI governance today at the federal level for better or for worse.
• 13:12
  And I guess part of the question is how much faith you have in certain agencies or officials to sort of get that right.
• 13:18
  And I think that remains to be seen.
• 13:20
  One important add on here, even though Congress isn't acting, they are proposing laws.
• 13:25
  There's about 115 right now bills pending.
• 13:27
  And several of them in the US Senate would actually delegate more authority to NIST.
• 13:33
  and NTIA, but specifically NIST, to try to exercise more of this governance role in this more flexible capacity.
• 13:41
  And a couple of those bills even start to give NIST some enforcement teeth and say, you can move beyond just the realm of best practices into maybe like best practices plus, plus
• 13:53
  a little bit of like finding authority if companies don't go along with these guidelines that they help formulate.
• 13:59
  Again, that has not passed.
• 14:01
  But that's an interesting development because it's once again Congress saying, well, we're not going to figure it out.
• 14:05
  We're going to kick it back to the agency, including agencies that have not traditionally had a regulatory role over the digital economy, but now might because of what they've done
• 14:16
  with their multi -stakeholder processes specifically in commerce.
• 14:20
  it's to be determined where that goes from here.
• 14:23
  And of course, the next election could affect this as well.
• 14:26
  Absolutely.
• 14:26
  No, it's fascinating because we are seeing this kind of exploration and experimentation with different regulatory models here, which at some level we should want because I agree
• 14:38
  with you, this is a new technology and certainly we know there's lots of problems with the existing regulatory structures we have.
• 14:44
  and I might not 100 % agree on what the problems are, but I think we all agree that we need to try these new models.
• 14:51
  Yeah, Phil Weiser, the attorney general of Colorado, had a piece when he was still in the law school, dean of law school in Colorado, called entrepreneurial administration.
• 15:00
  And I love that phrase, and I think that's exactly right.
• 15:03
  We want entrepreneurialism in the marketplace.
• 15:06
  We want entrepreneurialism in government.
• 15:07
  We want to see creativity, experimentation, trial and error, right?
• 15:11
  At the same time, we want accountability, and we want transparency.
• 15:14
  And sometimes, our goals come into conflict.
• 15:17
  You know, we have different priorities and that's really, really hard.
• 15:20
  Something's going to have to give and I think this remains to be seen and it's going to play out in a very messy way over the next couple of years.
• 15:27
  Okay, so speaking of messy ways, let's talk about the states and then we'll go and talk about the European Union.
• 15:32
  what do you see happening at the state level?
• 15:34
  Right.
• 15:34
  So in the absence of, in the sort of vacuum that's been left by Congress or Congressional inaction, a lot of states have been moving forward on digital technology policy over the
• 15:44
  past decade in a major way.
• 15:46
  Of course, they've done this with things like privacy and cybersecurity and other issues, but in AI, they're really moving fast.
• 15:53
  The last count I've seen from a tracking organization called multistate .ai is that as of today, there are 678
• 16:01
  AI related bills pending in the United States.
• 16:04
  That's a big number.
• 16:07
  That's an almost unprecedented level of legislative activity for any technology in my lifetime.
• 16:12
  And I've been doing this for 33 years.
• 16:14
  Now, not all of them are passing it, but a lot are passing.
• 16:18
  Just two weeks ago, Illinois passed four different AI measures alone in one week.
• 16:22
  And just this week, just yesterday, before we're taping this podcast, California legislature passed a major bill.
• 16:30
  on AI safety that's headed to the governor's desk.
• 16:33
  So the states are moving.
• 16:35
  And so the question is now what happens when you have sort of a patchwork of patchworks develop that is really unprecedented?
• 16:43
  Let's just jump back to our youthful days, Kevin, when we were doing these issues in the past for the internet, we saw Congress actually, and the Clinton and Gore administration
• 16:52
  in particular, take a more preemptive role in calling for a national framework for the internet and e -commerce.
• 17:00
  And you don't see that kind of appetite anymore at the federal level.
• 17:03
  There could be a number of reasons for that.
• 17:05
  Maybe they're just tired of dealing with these issues.
• 17:06
  Maybe they just all hate big tech so much.
• 17:09
  Who knows?
• 17:10
  But of all those bills that are pending at the federal level, as far as I can tell, absolutely none of them have any preemptive language whatsoever.
• 17:16
  And meanwhile, state leaders, like the sponsor of that California bill I mentioned, are specifically citing congressional inaction as their rationale for moving and saying, if
• 17:27
  Congress won't do this, we will.
• 17:30
  Well, then you have to add in the layers problem that I identified earlier.
• 17:33
  You've got the macro level, big picture regulation of AI, quah AI, like California is trying to do with its model, frontier model regulation.
• 17:42
  But then you have all the sector rules as well, and not just at the state level.
• 17:46
  I mentioned the 678 bills at the state level.
• 17:49
  That does not count municipal enactments.
• 17:51
  The most important AI bill I would argue passed potentially so far in the United States was New York City's AI bill on algorithmic hiring.
• 18:00
  applications.
• 18:01
  I mean, that's New York City.
• 18:03
  I mean, there's a lot of companies that do business in New York City.
• 18:06
  Well, whatever one thinks about New York City's enactment, and there have been many other cities that have followed suit, and even some counties, Miami -Dade County, moved a bill
• 18:13
  on AI policy.
• 18:15
  I mean, one has to ask at some level, I don't even know what the number is anymore.
• 18:18
  I've heard estimates of like, there's 90 ,000 different types of governmental jurisdictions in the United States.
• 18:22
  I'll tell you, who knows what it is.
• 18:23
  The bottom line is, I think we could all agree if you had thousands of AI policies at some level,
• 18:29
  just the confusing compliance cost of that creates some real challenges for the future of that marketplace.
• 18:35
  So that's where things stand at the state level.
• 18:38
  Why though does this not play out the way we saw with privacy or network neutrality where Congress didn't act, California did, California is bigger than most countries and
• 18:50
  essentially became a kind of de facto standard.
• 18:53
  It doesn't necessarily have to be California, but it's not.
• 18:56
  And there's lots of different state privacy laws that have been passed, but there's a lot of overlap between them.
• 19:02
  So it's not that companies have to do 50 different state privacy policies.
• 19:06
  Yeah, I think that's that's exactly right.
• 19:07
  I mean, this is how it's likely to play out in the short term for better or for worse.
• 19:12
  And it will be California that probably drives most of it, although it was Colorado that had the first major broad based AI law that Governor Polis signed, which, by the way,
• 19:21
  included a very interesting signing statement that read more almost like a veto statement where he was almost begging Congress like you need to do something, folks.
• 19:28
  I used to be one of you.
• 19:29
  I used to be a congressman.
• 19:30
  You need to act here.
• 19:31
  And yet all of his pleading is not going to necessarily get anywhere.
• 19:36
  And so I think we're going to continue to see more and more state laws pass.
• 19:39
  And I don't know how they'll be harmonized if at all.
• 19:42
  That patchwork could be very bad.
• 19:44
  I think a lot of people in industry and people who care about digital technology innovation like myself, we're trying to do our best to come up with frameworks that are
• 19:51
  better for the states to move as we've done in the world of privacy while we wait to see if Congress can enact a baseline privacy bill, which would probably be preferable.
• 20:01
  But if you don't get it, you don't get it.
• 20:02
  And you're going to have to go statehouse to statehouse and figure this out.
• 20:05
  and make the best of it.
• 20:06
  And I think that's the world we're going to live in next year again.
• 20:09
  And I think we'll see just as many rules.
• 20:11
  And it raises the question, will AI innovators be sort of squeezed between the California effect and the Brussels effect as we now turn to like international?
• 20:21
  I think you wanted to ask about.
• 20:23
  I think that's a real possibility.
• 20:25
  Having to contend with like what California or other leading states are doing while also contending if you're a larger player with what Europe wants.
• 20:34
  And it's very interesting that California has modeled some of its privacy legislation after some things in the European Union's GDPR.
• 20:40
  And now they have an EU office in San Francisco to consult with California legislators and innovators about how to comply with EU policy.
• 20:50
  Scott Weiner, who is the sponsor of the California bill that moved this week, was at that welcoming ceremony for the EU office in San Francisco.
• 20:57
  So that suggests there's almost a new axis of these two forces between international and state.
• 21:03
  with Congress just being asleep at the wheel in the middle.
• 21:07
  For better or for worse, I think that's the state of AI governance in the United States today and probably for the foreseeable future.
• 21:14
  So what is your take on the European AI Act?
• 21:16
  know, it's a big topic, but how do you see it?
• 21:19
  Well, on a big plus, the EU -AI Act is a risk -based kind of framework that attempts to say, let's take a hard look at different categories of risk.
• 21:30
  That's smart.
• 21:31
  I think that's the way we need to go about AI policy, generally speaking, risk -based, targeted, focused, and again, preferably more sectoral.
• 21:39
  I think on the downside, the Europeans have a tendency to say, well, everything is pretty risky.
• 21:44
  You know, here's a high -risk bucket.
• 21:45
  Let's put everything in it.
• 21:47
  And that can't be the way it is because then there's nothing that's left for you to innovate at all.
• 21:53
  There needs to be better, more targeted type of segmentation of high risk, medium risk, low risk, whatever the boundaries are.
• 22:00
  the bottom line is that this is going to be something that's going to be all encompassing because the Europeans are now seeking to essentially make regulation their leading export.
• 22:12
  I think there's a recognition in the EU that they've lost
• 22:15
  a lot of ground in the sort digital technology world.
• 22:19
  It's hard to name a lot of digital technology companies that are headquartered in Europe.
• 22:23
  They're not happy about that.
• 22:25
  I could make an argument about the relationship between the regulation and that reality, but I won't go in, I won't digress.
• 22:30
  The bottom line is it is what it is.
• 22:31
  And so the Europeans are very adamant now about like, everybody needs to follow our laws.
• 22:35
  But the problem is it's not just the EU.
• 22:37
  There's plenty of other countries that are looking to act on this front now and move their own types of frameworks.
• 22:43
  And, you know, meanwhile, you've got a whole different governance regime emerging in China and a juggernaut in China in terms of how they could be a leading competitor to the United
• 22:52
  States and Europe in the world of algorithmic and computational technology.
• 22:57
  So I'm very concerned about this.
• 22:59
  I think this is a problem.
• 23:01
  I think one of the things that used to be a nonpartisan thing going back to the Clinton Gore days and the Obama days was like the idea of digital trade and global free speech
• 23:08
  being a unifying theme that brought strange bedfellows together.
• 23:12
  And there was an effort to sort of uphold American values and defend American interests.
• 23:17
  But now we're stuck in these catfights and culture wars about these things.
• 23:21
  like, you know, just two weeks ago, you had a top EU official coming after Elon Musk with an open letter on Twitter about him hosting Donald Trump on the X platform for a debate.
• 23:32
  I'm like, wow, that is really something when EU officials are coming after American citizens or technology platforms, even one we might not like in the form of Musk Twitter
• 23:41
  and saying, you know,
• 23:42
  You should follow EU law for your election communications.
• 23:46
  I'm sorry, that's hugely problematic.
• 23:48
  That's hugely problematic.
• 23:49
  And in the old days, I think that's where like the Obama administration or Clinton would have stand up and say, OK, you've crossed a line here.
• 23:55
  That's not your right.
• 23:57
  But the idea of like harmonized digital open free trade and borders in the cyber world, know, this sounds archaic now.
• 24:04
  It almost sounds like, my gosh, you're just preaching the gospel of John Perry Barlow anymore.
• 24:09
  But it used to be more of a unifying theme.
• 24:11
  There were people who really believed in that vision of a more unified global speech and commerce world.
• 24:16
  And it's fading by the day, unfortunately.
• 24:21
  I'm surprised you're that negative about it because again, going back to where we started, if this is this incredibly powerful revolutionary technology around the world, then
• 24:31
  clearly companies around the world are going to want to innovate and be successful in this area.
• 24:36
  And governments around the world are going to want to have their own markets be successful in this area.
• 24:43
  So why is the trajectory not that we have this
• 24:48
  set of different approaches that get proposed around the world.
• 24:52
  And then essentially we hash it out in the marketplace and in other kinds of forms.
• 24:57
  Well, hopefully, you make it sound pretty easy, that hashing out to take place.
• 25:03
  We have a conflict of first principles on a lot of key matters, right?
• 25:07
  Let's just start with the First Amendment, right?
• 25:09
  And we could talk, say, it's American exceptionalism, whatever else.
• 25:12
  But clearly, the Europeans have their own priorities with privacy and data security.
• 25:17
  And the Chinese have a completely different set of priorities.
• 25:22
  we could go into the global south and look what happens.
• 25:25
  today in Brazil about them trying to ban Starlink down there because of a conflict about speech codes.
• 25:32
  These things are getting harder and harder to work out as these technologies become more pervasive in global markets.
• 25:38
  And it certainly could be the case that some countries do try to make a different, more positive play and attract more investment and innovators.
• 25:46
  We live in a world of global innovation arbitrage, and people are able to ease.
• 25:50
  move around more easily than ever.
• 25:52
  It's not like you have to pick up a factory and move a smokestack into a foreign country.
• 25:55
  You're just moving code and coders.
• 25:57
  And this is kind of what the story of what happened to Europe and how they lost a lot of their best innovators and investors to the United States in the 90s and 2000s.
• 26:06
  I hope that doesn't happen and that we bleed talent and investors to China or wherever else.
• 26:11
  I think it's more realistic that we just see this conflicting.
• 26:16
  of policies, again, we're already seeing it in the States.
• 26:18
  I think we see it more internationally.
• 26:20
  Take a look at what's happening with frontier model makers for AI today.
• 26:24
  They are signing on to agreements across the globe in the name of AI safety.
• 26:30
  And one could say, well, the more the better.
• 26:31
  It's great.
• 26:33
  Let all these safety agreements and accords and rules pile up.
• 26:37
  But at some point,
• 26:38
  You're going to have to have a spreadsheet to keep track of what did we agree to when we were at the summit in Japan versus the UK one versus the US one in California.
• 26:49
  That's not exactly the model of what we thought we were getting into with regards to a global internet, a freer internet world.
• 26:56
  It's one of a patchwork of many, many different conflicting policies for better.
• 27:01
  Let me just play devil's advocate and push you on that a little bit.
• 27:04
  I mean, we have spreadsheets and we've also got much newer technology like large language models and things that can do complex analysis.
• 27:14
  What you're saying, you know, without dismissing it sounds sort of like I remember in the the nineties when the Internet Tax Freedom Act came about, Amazon would come in and say,
• 27:23
  look, there's a thousand taxing jurisdictions in the United States and it's going to be possible for us when you make an order on Amazon anywhere in the U .S.
• 27:30
  to figure out what tax to collect.
• 27:31
  And nowadays, like every time I make an order on Amazon, they're collecting sales tax or not or whatever else.
• 27:36
  It's just a database.
• 27:37
  With today's technology, that's not a fundamentally impossible problem that killed Amazon.
• 27:44
  So why is just a little bit more burden on, especially if we're talking about the big frontier model developers who are pretty substantial companies, why is that such a
• 27:53
  tragedy?
• 27:54
  Well, you know, I'm not going to shed too many tears for Amazon.
• 27:56
  They're a big company.
• 27:57
  And the question is, obviously, like, what about everybody else?
• 28:00
  You know, mean, compliance costs are a real thing, and they absolutely do drive competitive advantage in some continents and countries.
• 28:08
  you know, America has been better than most about trying to keep those in check and make sure that we have a vibrant marketplace where companies and innovators of all different
• 28:16
  sizes can thrive and start the next great thing.
• 28:19
  I think there is a real danger, you know, even with the best
• 28:23
  spreadsheets and software in the world that you think you can like.
• 28:26
  We can figure it all out, like our standards are for every jurisdiction in the world.
• 28:30
  But I don't think it's that easy.
• 28:32
  mean, first of all, your example involves Amazon and sales taxes, which are a numeric value, right?
• 28:39
  I mean, if you translate this into algorithmic fairness and safety mandates, these are far more amorphous and fuzzy values.
• 28:48
  You and I came about in an age where we cut our teeth on FCC quote unquote
• 28:51
  public interest regulation, right?
• 28:55
  And then there was the famous thoughts about obscenity, know it when we see it and things.
• 28:59
  That's speech, but even outside of speech, when you get to things like the alignment debate in AI, we all want AI to be aligned with human values, but you need to define
• 29:08
  exactly what that means for purposes of concrete deliverables to a regulatory body.
• 29:13
  And I think if you have dozens or hundreds of different standards for AI alignment, AI safety, whatever else, okay, sure, maybe Microsoft.
• 29:21
  Anthropic, OpenAI, Google, and Amazon, among others, can thrive in that environment.
• 29:29
  But maybe, as they have with GDPR, they do at the expense of everybody else.
• 29:35
  At the expense of competition, innovation, new startups.
• 29:39
  Some of the small European AI makers had started pushing back during the time of the EU Act formulation, especially the open source providers, pointing this out, saying, look, we
• 29:49
  just
• 29:50
  probably can't comply with this because our compliance shop is basically the founder's wife, you know, who happens to know how to run some accounting software or something.
• 29:58
  We don't have an entire team.
• 30:00
  Amazon has an entire division devoted to legal and tax compliance, right?
• 30:06
  So these burdens do matter.
• 30:07
  And this isn't just some rabid free market libertarian thing.
• 30:10
  This is like something that everybody, I think, acknowledges, whether it's for speech or commerce.
• 30:15
  We have to make sure that we provide an environment that's conducive for entrepreneurialism of all sorts to flourish.
• 30:21
  And it doesn't mean we have a complete absence of rules and regulations, but it does mean we have a little bit more standardization and harmonization.
• 30:28
  Again, the Clinton -Gore framework was called the framework for global electronic commerce.
• 30:34
  We didn't try to regulate the global level.
• 30:35
  We pointed out, this is a global medium, and we at least ought to have some greater consistency there.
• 30:40
  And there was an
• 30:40
  effort by that administration and then the Bush and then the Obama to like follow through on that vision.
• 30:46
  I don't think that that's present anymore.
• 30:49
  I think there's more of a willingness not only just to regulate more, but to sort of like let the chips fall where they may and not worry as much about these consequences,
• 30:57
  unfortunately, because I think of an exhaustion of just like so much going on globally on this front.
• 31:04
  Yeah, I was on the working group that created that framework for global commerce.
• 31:09
  So I'm definitely familiar with that set of issues and that set of developments.
• 31:14
  But let me ask you, you make a really good point that some of these questions don't have precise answers.
• 31:20
  So what is the right approach to alignment of frontier models?
• 31:25
  What are the right things to do about fairness?
• 31:27
  even you can quantify, there's different ways to assess fairness and so forth.
• 31:33
  How then do those issues get resolved?
• 31:35
  Because one alternative is to say, just the companies do their best and we should just trust them.
• 31:41
  That runs into the problem that, of course, these companies, their incentives are not necessarily, whatever they might say about, we care about safety, their incentives are not
• 31:49
  always aligned.
• 31:49
  why we have regulation.
• 31:51
  So what would be the best path forward?
• 31:53
  Well, the best path forward is to circle back to where we started, which is a discussion about focus.
• 31:57
  I think you can get at something akin to AI alignment in the narrow, but you really almost can in the broad.
• 32:04
  And what I mean by that is that if we talk about AI alignment with regards to like, does this AI ML enabled medical device harm you or not?
• 32:12
  We have a concrete deliverable there.
• 32:14
  The Food and Drug Administration exists to enforce laws on that front.
• 32:19
  And that's where we can
• 32:21
  get very concrete about what we mean by AI safety.
• 32:23
  My algorithmically enabled device should not harm me or my health.
• 32:27
  The same way we can do that for finance, the same way we can do that for a driverless car, for whatever.
• 32:32
  When you get back to the broader picture, which is what I think a lot of people who write about AI alignment in the abstract want, they want that high level, I believe, of like,
• 32:42
  well, we're moving towards a world of AGI, and so the underlying computational systems and models have to be
• 32:50
  fair, non -discriminatory, unbiased, and safe.
• 32:53
  And like, who could disagree with that?
• 32:55
  But concretely, what that means in practice is a totally different ballgame.
• 32:59
  And they often just fall way short of specific deliverables about this.
• 33:04
  We can take broad steps to get us there.
• 33:06
  I mean, we all preach the same gospel of having humans in the loop and trying to make sure we you know, baking in quote unquote, ethics by design.
• 33:13
  And some of those ethics and best practices are easy.
• 33:16
  But a lot of the others are hard.
• 33:17
  And we see this in the debate about free speech, right?
• 33:20
  I mean, look at how we fight like cats and dogs about what we even mean by misinformation or disinformation that's algorithmically empowered.
• 33:26
  We've gone to the Supreme Court about this now multiple times.
• 33:29
  And Congress has entire standing committees now devoted to like, you know, weaponization of the federal government and like disinformation and blah, blah.
• 33:38
  We're not getting anywhere there.
• 33:40
  AI has entered the age of the culture wars now.
• 33:42
  And like we're fighting over those broad abstract things.
• 33:45
  The only way we get anywhere in the world of AI governance and regulation.
• 33:49
  is to get far more concrete to drill down into very specific types of harms in specific sectors in a risk -based way with cost -benefit analysis.
• 33:59
  It's regulating on the output side, like what comes out of a model and how it concretely affects us in a specific human context, not on the input side, the theoretical, like
• 34:10
  what's, I hear, I understand what critics say when they say, what about the black box?
• 34:14
  What's going on there?
• 34:15
  I'm like, you know what, I don't know.
• 34:16
  I actually don't know.
• 34:17
  I don't know everything about what happens in the black box.
• 34:19
  I don't know if we ever can.
• 34:20
  People who make the black boxes don't understand everything that's happening inside of it.
• 34:24
  But what we do understand is what happens on the output side of it, when it actually gets to interact with us in the real world.
• 34:30
  And if it causes the harm, then we pull it off the market, or we fine people, or we jail them, or whatever.
• 34:34
  We've got fines and penalties, and maybe we need more.
• 34:36
  We can talk about that.
• 34:38
  But that's the only way concretely we're going to get anywhere in the world of
• 34:42
  Okay, last question.
• 34:44
  You painted a picture of this increasing messiness and confusion.
• 34:50
  If we do ever pull out of that, if we go to a different trajectory that's more like what you're describing, what's the most likely scenario?
• 34:58
  Not necessarily that you think it's going to happen.
• 35:00
  What's the most likely scenario that gets the US or the world onto a different path?
• 35:05
  Well, if we would have this conversation a year ago, Kevin, I would have said there's still a possibility that the US could adopt a new broad -based algorithmic regulatory body
• 35:15
  and licensing scheme or maybe new liability scheme.
• 35:18
  I think the vibes have shifted over the last year.
• 35:21
  And those proposals that were being put out there by people like Senators Blumenthal and Hawley and many academics, they're not getting as much traction anymore.
• 35:28
  I think there's a recognition that that's probably not the right place to start.
• 35:31
  It doesn't mean it's going to go away entirely, but this idea of a
• 35:34
  broad -based new algorithmic AI agency, think, for now is dead.
• 35:38
  I think we could end up getting legislation in Congress next session that basically does what I mentioned before of signing off on executive branch authority to go out and do more
• 35:50
  to try to guarantee safety by design through existing processes, both in the narrowed individual agencies and then in the broad through the NIST and TIA structure that's been
• 36:00
  created.
• 36:01
  potentially,
• 36:02
  with maybe some Federal Trade Commission enforcement on the back end of that.
• 36:06
  That is a discussion for another day, and it's a very heated one.
• 36:10
  But the role of the FTC and other agencies, enforcement agencies, consumer protection agencies, as well as civil rights agencies to enter this is, think, the wild card question
• 36:20
  for 2025 and beyond.
• 36:23
  How do those bodies at the federal and state level enter the picture and try to enforce
• 36:29
  general laws governing consumer protection or civil rights in the context of algorithmic fairness, algorithmic transparency, whatever you want to call it.
• 36:37
  And this this animated a lot of the Biden administration's AI Bill of Rights.
• 36:42
  And there was a suggestion in some of these hearings recently that like there should be more of that.
• 36:47
  It could be we do get legislation that does that.
• 36:50
  I wouldn't rule that out, even if I probably would rule out now that we're going to have a federal AI commission or a new licensing regime for all things.
• 36:59
  All right, we'll see how things develop.
• 37:01
  Adam, thank you so much for fascinating, very informative discussion.
• 37:05
  These are incredibly important issues and I appreciate your time.
• 37:07
  Thanks, Kevin, I appreciate it.