Latest / The Road to Accountable AI / Lauren Wagner: The Potential of Private AI Governance

Transcript

Lauren Wagner: The Potential of Private AI Governance · The Road to Accountable AI

• 0:00
  Lauren, welcome.
• 0:01
  Great to have you on the podcast.
• 0:03
  Thank you for having me.
• 0:05
  Tell us a little bit about your journey.
• 0:08
  You've done a number of different things in your career.
• 0:10
  How did you make your way into AI governance?
• 0:14
  Sure, so I'm a computational social scientist by training back in 2010.
• 0:19
  I was looking at online social networks, so at the time mostly Facebook and Twitter, and figuring out if we could learn anything from the network structure about how it influenced
• 0:30
  individuals.
• 0:32
  So since then, 2010 and before that, I've always been thinking about how can you use technology for good and to make people feel more supportive, more productive.
• 0:43
  things like that.
• 0:44
  So after this research, I ended up moving into private sector.
• 0:49
  So digital health, Google working on the Google assistant in the early days, and then Meta building products to combat misinformation, also some projects on privacy protected data
• 0:59
  sharing.
• 1:00
  So the through line between all of those was figuring, there was a governance element to all of these different projects, starting with what I was doing in the academy.
• 1:11
  And then that really
• 1:13
  really put a finer point on it when I was working at Metta, combating misinformation, online harms, everything was related.
• 1:21
  There was an intersection between what we were building on the tech side, policy side, how this impacted users.
• 1:28
  So some of it really was a play in, I don't love this word, but self-governance.
• 1:33
  And how do we do the right thing or how do we take steps to build trust with users outside of
• 1:41
  of regulation and the law explicitly mandating it.
• 1:45
  So after leaving Metta, I saw the power of these levers.
• 1:49
  I mean, I was in this big company and I thought, there any way to do this kind of work where you're compelling companies to build more trustworthy systems outside of regulation
• 2:00
  and outside of the big platforms?
• 2:01
  So over the past two or so years, I've been working on various AI governance projects along these same lines with startups, VCs, Fortune 100.
• 2:11
  and also some direct policy advocacy as well.
• 2:14
  What was your experience like at Meta and Google in terms of the commitment to addressing these risks and harms of AI and how much of a challenge it was to actually make progress
• 2:25
  inside those organizations?
• 2:27
  Yeah.
• 2:27
  So at Google, I was very early on the Google assistant.
• 2:30
  So this was 2017.
• 2:31
  You had the assistant versus Alexa wars, and this was pre-transformer.
• 2:35
  So we weren't really thinking about these existential risks in the, confines of the product because they didn't really exist.
• 2:44
  We were just, I was helping to build the developer ecosystem.
• 2:48
  So we had some guard rails there, but it was, it was a zero to one product.
• 2:53
  So we were just trying to get to the first.
• 2:56
  the first phase, but obviously I was thinking a bit more about human computer interaction and what this would look like moving forward for users as I I called it like ambient AI.
• 3:07
  So as AI was kind of infused in everything and every interaction and every experience, what would be the knock-on effects there?
• 3:15
  So it was kind of a fun thought experiment at the time in terms of the practicality of the products that we were working with.
• 3:25
  At Meta, it was a bit different.
• 3:27
  AI was already infused in all of the products I was working on, whether it was news and ranking, and then combating online harm.
• 3:37
  So these fact-checking products, we used AI in all of those.
• 3:42
  so that kind of governance element was part of the day-to-day work.
• 3:49
  What are the guardrails?
• 3:51
  What are the guardrails for these products?
• 3:53
  How are we developing them?
• 3:55
  How are we putting them in production?
• 3:57
  And then monitoring what happened when things went live.
• 4:02
  So we worked with a lot of different external organizations, whether it's civil society, academia, policymakers, think tanks, et cetera, to help us with all of these different
• 4:13
  activities.
• 4:16
  And then you mentioned some of the things that you've done subsequently, but part of your work has been working with investors and VCs.
• 4:24
  So what is their perspective or perception, do you think, around...
• 4:34
  Well, it obviously is investor specific.
• 4:38
  The first project I worked with Responsible Innovation Labs, which is a nonprofit that was started by the founder of General Catalyst.
• 4:47
  And so it's funny that these days, responsible has a lot of, it's a weighted term, if we replace responsible with trustworthy, whatever it is.
• 4:56
  Having worked on AI in regulated or self-regulated industries,
• 5:01
  I saw the importance of thinking about governance very early on and how developers, engineers, founders, they're making decisions every single day about what the product is
• 5:12
  and what it isn't.
• 5:13
  And so you could say it's just product design and development and like day-to-day engineering.
• 5:19
  But if you really look at it, it's essentially you're making governance decisions about the product.
• 5:24
  And so the idea there was, can we...
• 5:28
  take some of the resources that have been put forward.
• 5:31
  I mean, this was back in 2023, which now seems like a decade ago, even though it wasn't.
• 5:38
  And so if you're building in a regulated space or a space where you really have to build trust with customers, users, know, it's AI, maybe it's higher risk, whatever it is, is
• 5:51
  there any way that we can help guide these companies to be more thoughtful, maybe have some more structured thinking around it?
• 5:58
  have some more documentation.
• 5:59
  And so I think that that yields more sustainable, durable, successful companies for specific kinds of companies.
• 6:08
  And I've seen that firsthand.
• 6:10
  And then when also speaking with later stage investors, what some of them are concerned about is there are a lot of unknowns with AI right now.
• 6:17
  And so a growth stage investor, an investor that would take a company public later on, they wanna make sure that governance process are.
• 6:25
  are in place early so that you don't have to retrofit as as like they come on board and they're looking at the company and looking to invest and looking to grow it and help
• 6:36
  accelerate.
• 6:37
  They're like, we want to make sure that you're kind of set up to succeed.
• 6:40
  So we're not having to change all of these things from a governance perspective as as we move in.
• 6:44
  And because AI at this point is really a paradigm shift, there is a need to pull more more resources and and people and kind of like thought behind solving that that
• 6:56
  So the main reason I was interested in speaking with you is you've been promoting the idea of market driven or private AI governance.
• 7:05
  And it's somewhat implicit in some of the things you've already talked about, but can you just describe what does that mean to you?
• 7:12
  What is that concept?
• 7:14
  Sure.
• 7:14
  So for me, what market-driven AI governance is, outside of laws being passed or a government or some standards body saying you have to do this or you have to do that, is
• 7:25
  there any way to align incentives in the private sector to compel companies to build more trustworthy AI systems?
• 7:32
  And so I did this, as I mentioned, from various different perspectives.
• 7:36
  It was kind of hypothesis that I had because I saw it within the big companies.
• 7:40
  I saw it with some of the early stage startups that I invested in and what led to sick, companies that really were, were successful and kind of the decisions they made early on.
• 7:49
  So I ended up working with, as I mentioned, investors, so venture capitalists, startups themselves, and then fortune 100 companies.
• 7:58
  And so they, as the, customers of these products are saying, how do we evaluate what's coming through the door, whether it's a big company or a startup.
• 8:09
  And so I thought, okay, if I can play in that space, that's a really big lever.
• 8:14
  So if we develop criteria that makes sense for both the enterprise and the startups, you can really have kind of an ecosystem wide push to move companies.
• 8:26
  And I don't want to say a different direction, where governance is considered earlier on.
• 8:35
  the incentive mismatches.
• 8:37
  Presumably you're talking about something more than just for-profit companies don't want to be held back in deploying new products by regulation or by limit.
• 8:47
  Yeah, I don't, I think that's a very nice, like it's a neat narrative.
• 8:54
  say, they're moving too fast.
• 8:55
  They don't want to do this.
• 8:56
  But the fact of the matter is these teams are so small.
• 8:58
  I've worked at early stage startups.
• 9:00
  I work with startups now.
• 9:02
  They don't necessarily think about it.
• 9:03
  It's like, you don't know what you don't know.
• 9:05
  And so what I'm, what I was trying to do here is really understand what the pain points were for these enterprise customers.
• 9:14
  And so it turns out that when they're evaluating third party AI systems, a lot of the kind of the checklist that they have is very risk oriented.
• 9:24
  And so it does come out of this compliance space, even though there may not, there are laws on the books for AI, but they're really adapting from other checklists they have.
• 9:32
  And it doesn't help them understand, is this going to generate value?
• 9:37
  And is this going to present risks to our organization that we maybe didn't anticipate or could mitigate?
• 9:44
  if only we knew and can kind of put the pieces together and also bake this into a contract.
• 9:49
  So the liability, know you want to talk about that, but that's a big question.
• 9:54
  So these companies are looking at startups, they're looking at big AI companies, there are a lot of unknowns, and they're saying, okay, if this goes wrong, what company is less
• 10:06
  risky for us to work with?
• 10:07
  And ends up being a big company.
• 10:08
  they think, all right, if it's not baked out of like, who's at fault for this, for this?
• 10:12
  At least we can sue someone or at least like there's a company with a big pile of money and we can kind of figure it out or sort it out.
• 10:20
  And so I think like one of my personal ethos is that to mitigate the risk of technology, we need more people with eyes on the problem who can build and potentially build new
• 10:36
  technological solutions.
• 10:38
  So when I see startups that are potentially stuck
• 10:40
  have a great technology, but potentially they're stuck in procurement and they can't get those design partnerships.
• 10:45
  And they're wondering why an enterprise isn't moving forward.
• 10:49
  And I know it could be just because of this like liability issue.
• 10:53
  They don't quite trust it and they don't know how to evaluate it, but they don't want to say these things.
• 10:56
  And they're just going to default to going with a bigger company.
• 10:59
  I see that present negative effects for the wider ecosystem outside of, I invest in early stage startups.
• 11:05
  I want them to be huge and I want them to be successful.
• 11:09
  So there are lot of different equities at play and I see this as benefiting the whole ecosystem and users.
• 11:18
  What exactly is missing that the big companies need to get that kind
• 11:25
  there I mean, at a very high level, as I mentioned, the checklist today are very risk oriented.
• 11:31
  There's very little that really touches on value and also risk mitigation.
• 11:38
  so one, some of this is going to sound very simplistic and it is an oversimplification because I've spoken to, you know, dozens of companies.
• 11:48
  but at a high level, like, let's get back to basics.
• 11:52
  How is your product built?
• 11:53
  What's the tech stack?
• 11:54
  Where is AI actually used and where is it not used?
• 11:57
  So a lot of companies, startups, especially, you know, they're selling it's AI.
• 12:03
  It's shiny.
• 12:04
  We're doing this.
• 12:05
  We're doing this, but that black box element to it, which people would say, it's the secret sauce that could actually hurt a company.
• 12:11
  And so when I talked to early stage startups, is it walk them through like the end to end user journey and show them exactly where AI is being used.
• 12:19
  Because all that an enterprise at times, like when an enterprise sees is like, no, I don't, I don't understand this.
• 12:25
  Like this seems risky.
• 12:26
  Maybe we should build something ourselves, which like, are they capable of that?
• 12:31
  Who knows?
• 12:31
  It depends on the company.
• 12:33
  And so something as simplistic as like, what is the tech stack look like?
• 12:36
  What is the user journey?
• 12:38
  Where is AI where, where does AI not used?
• 12:41
  understanding what we would call fourth party integration.
• 12:45
  So.
• 12:46
  What models are you building on top of?
• 12:48
  Are you fine tuning things like that?
• 12:50
  Copyright certainly comes into play and data ownership.
• 12:54
  it's not even, are you legally allowed to train on certain types of information?
• 12:59
  Are we going to get in trouble as a company if we use this?
• 13:01
  And it turns out it's not yours, but when our employees or whomever use the product, who owns that data?
• 13:08
  Or is it going back into the product?
• 13:09
  Do you own the data?
• 13:10
  And so working out these major questions and then coming to an agreement that's
• 13:16
  codified in a contract and there's actually accountability there is kind of where I'd like to see the ecosystem move in addition to more proactive transparency from the lab and AI
• 13:30
  company side, which I'm happy to talk more about.
• 13:34
  Yeah, why don't you?
• 13:34
  Where does transparency come into play and what exactly do you mean by transparency in this kind
• 13:39
  Yeah, so I think there is a lot to learn.
• 13:42
  Some people might say, from the late, the last era of social media, it's not even the last arrow.
• 13:47
  Like now things are running in parallel and AI is part of these companies.
• 13:51
  But I think you can learn a lot.
• 13:53
  we, I mean, I worked on Facebook, open research and transparency.
• 13:56
  So we did a lot of work on transparency, whether it was reporting or sharing privacy protected data with academics and policymakers so they can understand what was happening
• 14:06
  with the platform.
• 14:07
  And so looking at the transparency measures that have been adopted as standard practice among the AI labs, you have papers that have been published, which great, the more people
• 14:17
  understand the technology, the better.
• 14:20
  So I think that that's been working pretty well.
• 14:23
  I'd like to see more things around peer review when you're publishing outside of the academy, but it seems that that's coming.
• 14:30
  And then model cards have become standard.
• 14:33
  And so those were developed years and years ago, the team that did it, you it was an uphill battle and it's amazing to see how it's really diffused throughout the ecosystem.
• 14:42
  But the genesis of Model Cards was for technical audiences.
• 14:46
  I mean, at the time you didn't have people in the White House or, you know, business people within these big companies really having serious conversations about AI.
• 14:55
  And so the information in Model Cards is being used to make business decisions and policy decisions.
• 15:01
  So is it time for us to have maybe a compliment to a model card, whether it's an AI vendor card that has other types of information that can support that decision-making?
• 15:13
  And so what I see there is it's kind of like, I don't want to say a consulting product, but it's a project of like understand the needs, what information do people need?
• 15:23
  What information would an AI lab or a startup...
• 15:27
  feel comfortable sharing, but it's also in their benefit to share and be proactively transparent around it.
• 15:32
  And from speaking with a lot of different kinds of companies, it just seems that people don't know quite know what to share and they don't want to set themselves back.
• 15:39
  They don't want to be transparent and have them end up being like behind if they're in competition to win a deal or something and they're more transparent.
• 15:49
  But if we have a project where we can align from the enterprise side.
• 15:54
  or the policies that like, this is actually what we need and it's in your benefit to share it and then kind of have it be an extension of a model card.
• 16:01
  So it's both a process of understanding needs, aligning incentives, but then also what's a seamless go to market here?
• 16:08
  And to me, that's an extension of a model card.
• 16:11
  You built a muscle to have this kind of transparency, like let's just extend it.
• 16:15
  So it's not a net new lift for companies.
• 16:20
  Does it make sense to standardize those kinds of elements across organizations?
• 16:27
  Obviously, there's a collective action problem.
• 16:29
  If each company needs to come up with its own set of requirements and each startup is responding to that.
• 16:35
  So there's benefit of having a lot of commonality on the other hand, then it's a heavier lift to get everyone on board and there are differences among them.
• 16:42
  Yeah, I I think companies should be able to share what they want or what they don't want.
• 16:48
  If there are incentives to share certain kinds of information, great.
• 16:51
  Hopefully more companies orient around that.
• 16:53
  But we see it in the last, I want to call it era.
• 16:57
  I mean, these timelines are so short, can we call it an era?
• 17:00
  But if we looked at companies working in trust and safety when they were making rules around content policies and it was about specific pieces of content and things like this,
• 17:11
  I also did research when I left Metta where I spoke to dozens of people across different companies.
• 17:16
  And what ended up happening was Facebook ended up being the gold standard because they had to put the most, well, a lot of resources behind both doing this work and also making this
• 17:27
  work public and communicating it effectively.
• 17:30
  And so when a startup who had trust and safety considerations or had to manage online harms,
• 17:37
  They would go, you know, that person would go online and say, like, what's this company doing?
• 17:41
  What's this company doing?
• 17:41
  Meta seems to really robust policies.
• 17:43
  We're just going to take what Meta is doing and we're going to adopt that into our own work.
• 17:47
  So we've seen, I've seen that diffusion happen on the ground.
• 17:51
  And I, I do think that if certain big labs are bought into this and start doing this, other companies will look and kind of adopt this as a, as a framework.
• 18:00
  And there are civil society organizations, academics, cetera, and folks who can also test this and publish papers and say,
• 18:07
  this is comprehensive, this is not comprehensive.
• 18:09
  So by directing attention to it and giving enough guidance of this is what we think it should look like and this is what we think is effective and here's why, you get more eyes
• 18:20
  on the problem and people iterating and refining.
• 18:24
  The obvious question with any private governance activities is whether there's a strong enough incentive without a government mandate, some enforcement possibility for
• 18:34
  non-compliance.
• 18:35
  So what makes you confident that there is enough if this is coming privately from organizations?
• 18:44
  So there is incentive on the enterprise side to get this done.
• 18:48
  I know this from working with these companies and they may, everyone on their earnings calls and said, AI this, AI that, this is the future.
• 18:57
  So they may not wanna say publicly like, we have a strategy but we're not sure it's the right strategy.
• 19:03
  We're open to speaking to a lot of different startups.
• 19:05
  We're open to shifting, we need thought partners.
• 19:07
  And so the consultancies are coming in like.
• 19:10
  a McKinsey and then you also have like an Accenture and they're both doing helping with that strategy work and also partnering with startups and other kinds of organizations to
• 19:20
  make them aware of the products that are available.
• 19:24
  But there is a question of like, who are those who are on those teams and like are like I think there's an opportunity to just uplift all of these different entities.
• 19:35
  And so
• 19:36
  It's already happening on the enterprise side.
• 19:39
  On the startup side, these companies want to be successful and sell.
• 19:43
  The key here is codifying it in a contract.
• 19:47
  And so you could say all you want, like, yes, we should know.
• 19:52
  And there are like technical issues with some of this too.
• 19:54
  Like, can you actually know all of the data model is trained on?
• 19:58
  But if you have a formal attestation of the company is saying XYZ, then lawyers are involved.
• 20:04
  And so.
• 20:05
  you need a way to monitor what's happening on an ongoing basis.
• 20:08
  So this isn't just a one time you sign the deal, you're in, people are using your product, but what's happening on an ongoing basis, that's something else that comes up a lot in
• 20:18
  these procurement conversations, which is actually astonishing because these products change as new, you know, research techniques come into play.
• 20:28
  So the products are changing, the data is changing, and you have a contract that's like for one point in time.
• 20:33
  So that doesn't work.
• 20:34
  So
• 20:34
  How do you create formal attestation so that you can then hold companies accountable?
• 20:42
  So this is all, it's happening, but it's still, as I mentioned, like things are moving so fast.
• 20:47
  I don't wanna say it's an experiment because it's not quite at experiment level, but we have to see how the, I think we should see how this plays out before some of this is made
• 21:00
  into a law or I know tons of states are proposing.
• 21:04
  new laws, but this is this is my perspective and what I'm most excited about.
• 21:09
  And you alluded to this before, but what role does the prospect of private legal liability play in all
• 21:16
  Um, quite a challenging area, as you know.
• 21:23
  Um, so as of right now, the light, like there's still a lot of question marks around liability and laws have tried to push this in many different directions.
• 21:35
  And so we haven't seen, I like to look at like,
• 21:40
  cyber attacks, cybersecurity, cyber insurance, things like that.
• 21:43
  And if there are any lessons we can draw from that world into now what we're seeing with AI assurance.
• 21:49
  And so I think there are just a lot of questions.
• 21:52
  Like we haven't had a major incident.
• 21:56
  Cybersecurity sure, and there are like some AI elements associated with that, but we haven't had even not necessarily the sci-fi situation, but something that was hugely
• 22:05
  damaging.
• 22:06
  And it raises all of these new questions around.
• 22:09
  liability.
• 22:10
  So where we are is not quite that people are walking on eggshells.
• 22:13
  They're like, okay, we'll try this.
• 22:15
  We'll do this.
• 22:16
  The contract says this.
• 22:17
  And we'll kind of just see what happens.
• 22:22
  So I'm waiting for that.
• 22:24
  We'll see if a major incident arises and kind of what what happens there.
• 22:29
  But people are buying insurance to account for these AI risks.
• 22:36
  It's not, if you look at the different policies, it's really not that comprehensive.
• 22:40
  Some have uncapped, but that's basically just like a Hail Mary.
• 22:43
  Like we hope nothing happens.
• 22:47
  So companies really aren't covered.
• 22:50
  So I'm hoping that by developing these new kinds of contracts and having these considerations, we're starting to put some stakes in the ground around what that could
• 22:59
  look like moving forward.
• 23:01
  Right, contract is obviously one way to deal with liability to the extent that you're able to contract around things and courts are willing to honor that.
• 23:09
  Insurance markets in theory are the efficient solution because then you've got a private actor that has its own financial incentives to work on the customers and so forth.
• 23:19
  What do you think it will take to help those insurance markets mature in this area?
• 23:26
  Yeah, I'm curious what your thoughts too are on any parallels to cyber insurance because I do remember, I mean, I was most engaged with this space years ago at this point, but
• 23:35
  pricing those plans was incredibly challenging.
• 23:38
  You had entities, lot of like,
• 23:41
  public entities, whether it's hospitals or utilities and things like that were experiencing cyber attacks and trying to buy insurance from these municipalities.
• 23:49
  And it was very challenging for them to have plans developed.
• 23:53
  It's not just like the big Fortune 100 companies of the world.
• 23:56
  is like municipalities who are being affected.
• 23:59
  And so there's a pricing issue and like what is included in these plans.
• 24:04
  I think right now I've seen plans that really cover kind of the copyright training piece that like
• 24:11
  content provenance.
• 24:12
  And so it seems that insurers can kind of get their heads around this, like we can guarantee through insurance and we can work out liability and what the payment would look
• 24:20
  like around content provenance.
• 24:23
  But beyond that, haven't seen, I haven't seen much.
• 24:28
  Yeah, I haven't either and that's why I'm curious because presumably that would be a good outcome but the question is what can be done to hasten it.
• 24:36
  Well, the other piece here is the measurement piece and benchmarks.
• 24:39
  And so I work with ARC Prize, which is an AI benchmarking organization.
• 24:43
  And in order to develop insurance policy, you need to actually know what's going on with the technology and set thresholds.
• 24:51
  And I think that's something that the EU AI Act is trying to kind of like bring, make reality through developing the code of practice.
• 25:02
  And I speak with those folks and there are a lot of challenges around that.
• 25:05
  given that the benchmarks are in flux, the evals are in flux, who does the evaluations, who does the auditing and things like that.
• 25:12
  And so we need to have a stronger measurement ecosystem so that you have precision to be able to build these kinds of policies in this insurance market.
• 25:24
  kinds of things can governments do more effectively to promote these kinds of market-based approaches?
• 25:31
  You mentioned the EU AI Act, that's obviously a more heavyweight government set of mandates that's then pushing that code of practice.
• 25:38
  But are there ways to get to these kinds of results without that kind of prescriptive regulation?
• 25:46
  I think that having a safe space for knowledge sharing is key.
• 25:49
  So I did this work through the Data and Trust Alliance, which is a Fortune 100 industry consortium made up of lot of different executives of various companies.
• 25:59
  And so if there's any way for government to support more of these, if not just industry groups, but really public-private partnerships.
• 26:10
  So when I think about
• 26:11
  the measurement side of things and talking about these risks, whether it's something that's an egregious risk, like a catastrophic risk or something that's a little bit more
• 26:21
  kind of like less egregious, I guess I would say.
• 26:26
  Like what role can the government play in supporting that ecosystem and bringing some rigor to it?
• 26:32
  And when I think about USG and the unique kind of like differentiated knowledge base, I don't work in the government, I've always worked in the public sector, but when we think
• 26:40
  about
• 26:41
  bio weapon race, chemical race, things like this, like the government knows the most about that from from everyone.
• 26:48
  I mean, they have the labs.
• 26:49
  And so is there a way in terms of prioritization for the government to say, like, look at what they do best, where they have differentiated knowledge, and then partner with these
• 26:58
  outside experts to kind of up level some of that and also help grow the ecosystem and all of these key considerations, whether it's measurement evals and benchmarking or
• 27:10
  let's say like what's happening in the insurance market that's a little bit further afield, but like what can the government do today to both codify, standardize, bring more
• 27:20
  rigor to this world and then also help like accelerate it.
• 27:25
  Do we do need governments to adapt AI specific rules?
• 27:31
  So there are a lot of laws on the books that already deal with AI.
• 27:35
  What I think is really interesting is public sector procurement.
• 27:39
  And so I was looking at this a lot during the Biden administration as I started this work, this procurement work with the data and trust alliance.
• 27:48
  So what I believe ends up happening is that the government sets standards for AI procurement and...
• 27:57
  private sector will look at these and say, they're like, all right, we have this checklist, like, we're not sure this is comprehensive and this is working.
• 28:03
  Let's see what the government's doing.
• 28:04
  Like they buy a lot of stuff.
• 28:06
  And so they look at this and then adopt, like adopt some of those, those principles into their own procurement work.
• 28:12
  And then on the lab side, what happens is if a company think of like, this is just an example, but like a Microsoft sells essentially to everyone.
• 28:21
  And so they're selling to the government.
• 28:23
  And they use these procurement criteria to build out their go-to-market strategy, build out their sales strategy.
• 28:29
  And if it ends up working, they might say, let's take some of that and pull it into our private sector practice and take some of those.
• 28:36
  So I see public sector procurement, whatever those guidelines are that are developed.
• 28:42
  And now we have the action plan out of the Trump administration.
• 28:46
  So we'll see what comes out of that.
• 28:48
  And I know folks that are working on it.
• 28:50
  I see what Biden had put forward.
• 28:53
  It was like fairly comprehensive, but there was still a lot that needed to be worked out.
• 28:57
  But I'm really looking to that as something that will likely set standards and set industry practice outside of just the government.
• 29:08
  How can companies deal with the variety of different rules that are out there, especially globally, if you've got a Fortune 100 company, they're going to be operating in Europe,
• 29:18
  they're going to be operating in the US, Asia, which right now there doesn't seem to be lot of prospects of complete alignment in terms of AI policy.
• 29:28
  It is very complicated.
• 29:30
  don't, it's why when, mean, you know, that I worked on this, this AI bill in California over the summer, SB 1047, and something that we spoke about a lot was,
• 29:41
  what would happen?
• 29:42
  mean, in this instance, California would have led and like that may have been adopted by a lot of different states and it would have had outside impact because it wasn't just
• 29:49
  companies based in California, was operating in California.
• 29:53
  But when you have a patchwork of state legislation that you have to comply with, what does that look like?
• 29:59
  When I was at Meadow, we had CCPA where it was just California.
• 30:03
  So we would have different rules for California and some other states, but
• 30:07
  It wasn't that we had to go state by state and change our strategy for every seat.
• 30:11
  And then you look at it globally and what's happening with the EU, we had GDPR, CCPA.
• 30:17
  Like those were the kind of the big ones that we had to adhere to at the time.
• 30:20
  This was years ago.
• 30:21
  But if you have completely different rules, it is quite challenging.
• 30:28
  And then also with the EU and the code of practice that they're building there, I mean, this really is for
• 30:36
  frontier models, so the biggest models, but how do you have to evaluate them a certain way?
• 30:43
  You have to report out certain information.
• 30:45
  You need to have auditors.
• 30:46
  So it's not just you as a company having to report out information.
• 30:49
  You have to engage like all of these different parties to do this.
• 30:53
  And so it's worth, mean, I'm sure someone's, someone somewhere is building like a map of like how you actually operationalize this.
• 31:01
  But what I've seen coming from
• 31:04
  I'm someone who builds and who builds products and ships products.
• 31:07
  I've worked with a lot of people at think tanks who put forward these ideas of regulation should look like this and look like this.
• 31:13
  And sometimes they don't quite think through like, how do you actually operationalize this?
• 31:18
  And that to me is always like the key challenge and what I go to first.
• 31:23
  So short answer, I don't know, it's really hard.
• 31:27
  And just, you you talked about SB 1047.
• 31:32
  Just say a little bit, you were really on the opposition side to that bill, which eventually was vetoed by the governor.
• 31:38
  What was so problematic from your perspective?
• 31:41
  So let me just tell you how I got involved in this bill.
• 31:44
  So I had been working on these AI governance projects.
• 31:47
  And yes, governance was a big part of my work when I worked at tech companies.
• 31:51
  But I thought, okay, if I'm saying I do AI governance, I should know how AI bills are being created and passed on the ground.
• 31:59
  And so I started tracking SB 1047 just as a bill that sounded interesting back in January, February.
• 32:06
  And then that turned out to be the bill that got a lot of traction.
• 32:11
  like a lot of attention, which I think rightfully so, but I guess that's how politics goes.
• 32:17
  You kind of tie yourself to one thing and like sometimes it blows up and sometimes it just fizzles away.
• 32:24
  And so I started writing about this bill.
• 32:27
  A lot of chatter was happening online, whether it was on X or blogs or podcasts.
• 32:33
  And I just thought, how can anyone even make some, I was obsessed.
• 32:37
  like, okay, I'm going to pull all this together and start writing some.
• 32:40
  some articles just to help educate people about what's coming and what the potential implications are here.
• 32:46
  And so that bill changed a lot from when it was created to when it was ultimately vetoed and it was over a short period of time.
• 32:56
  where it ended up in a very different place from where it started, where it started was to have a new entity or a subsection of an entity within the government, the state of
• 33:07
  California, they would be...
• 33:10
  have models submit information, they would be able to say this is a good model and a bad model.
• 33:15
  And there would be an also an eval component of it where you would have auditors that would be evaluating this, the different AI labs.
• 33:25
  And so it's not helpful to like dissect the details of what the bill started out as versus where it ended.
• 33:34
  But for me creating these kind of like net new organizations that would have
• 33:40
  oversight over companies and would codify it in law.
• 33:45
  There was also issues with downstream liability.
• 33:48
  So the developers would be liable if the model was used for something that was against what the law had laid out.
• 33:58
  So these kinds of issues kept bubbling up as something that would set precedent and that would change the ecosystem.
• 34:07
  There was talk of,
• 34:08
  It would hinder open source development, would make developers liable.
• 34:13
  So these, and this like centralization element, this centralized oversight and empowering this new group for all of these reasons, I just, I thought it was premature.
• 34:24
  Yeah, I one positive, at least from that experience is, as you said, there was a huge amount of debate from both sides and back and forth.
• 34:31
  And, you know, as with anything, some of it was not very well thought out.
• 34:35
  But I think a lot of cases there was really deep engagement, you know, both at a technical level and a policy level on that bill, even though ultimately it was vetoed.
• 34:45
  So the last thing I want to ask you is just, you know, going forward, are you optimistic that we will be able to have
• 34:51
  productive conversations on both how to define this market-based AI governance and how to find the right intersection between what the government does and what companies do.
• 35:05
  Yeah, so I think after the bill, after SB 1047 was vetoed, Newsom pulled together this group of individuals who would be looking at what AI governance should be for the future
• 35:17
  of the state of California.
• 35:19
  And that report just came out.
• 35:21
  And I was very heartened by it because I thought it was he assembled a group like you could tell quite thoughtfully people who had a diverse range of views, but were incredibly
• 35:32
  technically sophisticated and could have a productive
• 35:35
  conversation.
• 35:36
  And so the recommendations that came out of that, I support many of them.
• 35:39
  I will write something with some, you know, more ideas.
• 35:43
  But I think that's a great example of taking someone and who knew if you knew some like delegated this to like, I doubt that he knew all these people personally at the time, but
• 35:54
  whoever was in charge of kind of bringing this group together, did it exactly right.
• 35:59
  And you can't have it's not that one voice kind of overshadows or one point of view overshadows.
• 36:04
  everyone else, but how do we work together to figure out what the future looks like?
• 36:09
  And so there are a few things, this private AI governance work, I'm hopeful seeing what organizations like the Data and Trust Alliance are doing.
• 36:18
  I think it requires being able to work with a lot of different kinds of stakeholders and then also really thinking about, and this is like the tech person in me, but like, is the
• 36:27
  go-to-market here?
• 36:28
  Like we don't need more frameworks.
• 36:30
  How do we actually fuel?
• 36:32
  adoption and make this palatable and useful for all of these different kinds of groups.
• 36:36
  So that's one piece.
• 36:38
  I'm also really interested on the policy side, like seeing what happened with SB 1047 and the chatter that was happening online.
• 36:48
  It was challenging for me as someone who was just personally obsessed and engaged to kind of understand all of these moving parts and all of the commentary that was happening and
• 36:59
  then the bill would change.
• 37:00
  And so is there any way to support the end-to-end policy making process by actually leveraging AI tools?
• 37:08
  So we don't get into a situation where a bill is made public.
• 37:12
  And this happened kind of with SB 1047 where tech people are like doing their jobs in SF or in California and elsewhere.
• 37:21
  I mean, it got international attention.
• 37:23
  They're like, wait a second, what was proposed?
• 37:26
  Like, what is getting traction?
• 37:27
  And so...
• 37:28
  Is there any way to actually use AI to make this clearer both to legislators, policymakers, staffers of like what the interests of the community are and how they
• 37:38
  actually feel about things so that it's less of a massive surprise and we can kind of bring people along.
• 37:45
  So that's what I'm really excited about it.
• 37:47
  I'm working with RAND, Tony Blair Institute and Stimson Center on that.
• 37:52
  Great, Lauren, thank you so much for your time.
• 37:54
  Thank you.