Latest / The Road to Accountable AI / Logan Kelly (Waxell): The Accidental Agent Governance Company

Transcript

Logan Kelly (Waxell): The Accidental Agent Governance Company · The Road to Accountable AI

• 0:09
  Hi, I'm Kevin Werbeck, Professor of Legal Studies and Business Ethics at the Wardens School of the University of Pennsylvania.
• 0:15
  For decades, I studied emerging technologies from broadband to blockchain.
• 0:19
  Today, AI is promising to transform our world.
• 0:24
  But AI needs accountability, mechanisms to ensure it's developed and deployed in responsible, safe, and trustworthy ways.
• 0:32
  On this podcast, I speak with the experts leading the charge for accountable AI.
• 0:41
  Waxhell started out creating a sales engagement platform and ended up building a control plane for autonomous AI agents to address the challenges of agents spending wildly,
• 0:50
  leaking data, exposing vulnerabilities, and spotting more agents outside the governance perimeter.
• 0:55
  In this conversation, CEO Logan Kelly walks me through what agent governance looks like in practice and what it means to make it accessible to business people in addition to
• 1:05
  entrepreneurs.
• 1:07
  Logan, great to have you.
• 1:08
  Welcome to The Road to Accountable AI.
• 1:10
  It's Kevin.
• 1:11
  I just bear.
• 1:14
  As I understand it, you didn't start out trying to build an agent governance company.
• 1:18
  Uh so tell us the the story of how you wound up doing Waxella.
• 1:23
  Yeah.
• 1:24
  So we started as a sales engagement platform kind of built from the ground up with AI.
• 1:33
  Uh and and quickly realized that people didn't really want to learn another software, especially we were focused at that time on kind of the SMB, right?
• 1:41
  So they had Hopspot and some of them had the sales lofts and outreach.ios of the world.
• 1:47
  There's a million tools.
• 1:49
  So we said, what if we could just do everything for the
• 1:52
  for the user and that, you know, kind of has become what we call agents.
• 1:58
  Um, and then once we launched the agents, it was like, wow, we're not, we're not uh kind of at the mercy of them clicking a button to to be, you know, spending money on the
• 2:10
  tokens.
• 2:12
  That agent starts working, it's gonna burn all the tokens.
• 2:15
  Then it becomes a data, you know, quality per issue.
• 2:18
  And then it becomes uh, did it say the right thing?
• 2:21
  And so
• 2:23
  As we launched these, like early last year, we started to to look around for platforms that could do this and and we couldn't really find anything because it was, you know, we
• 2:33
  were pretty early and it's just such a complicated world where if somebody solves this problem, there's a lot of open source code and and this kind of stuff.
• 2:42
  And that kind of led us to we have a small team and we, you know, we've got smart people who are not engineers.
• 2:50
  And so we needed to give them a surface that they could really.
• 2:53
  be a part of that and that, you know, as we, you know, have progressed in the company, that's become a a big value prop because agentic governance shouldn't just be a bunch of
• 3:01
  engineers running around with their hair on fire.
• 3:03
  It should be, you know, finance, legal, compliance.
• 3:06
  Everybody needs to have the visibility and the the ability to do that.
• 3:09
  So uh that we kind of innovated through you know, the the problem and and ended up getting a lot more excited about, you know, the the controlling agents and and building
• 3:23
  a really sweet governance surface as opposed to, you know, just being another sales engagement tool.
• 3:29
  So you define the the problem set.
• 3:32
  How do you understand what the solution is that's needed to address the agent governance challenge?
• 3:39
  Yeah.
• 3:39
  Uh it in the early days, it was problems that came to us, right?
• 3:47
  So you see the the behavior of an agent, and these are probabilistic and very, very complex, right?
• 3:53
  So, you know, there's this you can start to try to govern the prompt, right?
• 3:58
  And you can start to try to inject, you know, different instructions into a prompt, but you start to realize very quickly as you deploy agents or you should that.
• 4:08
  You start to need to the the AI is telling the agent to take a certain action.
• 4:14
  So now it's running a function and now it's accessing a database and now you have human identity, right?
• 4:19
  So the early days of understanding kind of this like primordial soup of all the different problems that could be contained in in, you know, a gentic governance were kind of
• 4:30
  experiential.
• 4:32
  And then we took a step back and said, we need a lab that we can start to
• 4:36
  you know, really experiment and and test with different use cases and and different, you know, agentic frameworks and different run times and all of this.
• 4:44
  So we've gone from experiential to very much a uh, you know, day-to-day new new system comes in into play and and now you put it into the lab and you try to break it, you try to
• 4:56
  see what the behavior is and, you know, who who who in a company is going to to be, you know, or what element of a company is it a cybersecurity issue or
• 5:05
  uh finance issue, these kinds of
• 5:08
  Walk us through then what the solution you built looks like.
• 5:12
  Yeah, so we call it a we call it the control plane.
• 5:14
  So uh in an organization, you have what what we would classify as three sets of agents.
• 5:23
  So a lot of companies who are just getting started with agents, the agents that they know best are things like cloud code, cloud cowork, right?
• 5:31
  Uh co-pilot, the these kinds of things that are interfaces with a uh you know, with a user, but they're not built.
• 5:41
  by the company.
• 5:43
  And that kind of creates this whole surface of okay, you have an agent, right?
• 5:47
  Where a user is saying to do something and now it's going to go access the file system or it's going to go, you know, potentially like in cloud code, like could delete a production
• 5:58
  database.
• 5:58
  Stop it, it's happened.
• 6:00
  And so so we have that.
• 6:02
  And so that's called waxel connect where people we we have on machine uh
• 6:09
  apps that that get downloaded and then we have the kind of control plane, our interface where the organization can start to put policies in place using what we call dynamic
• 6:19
  policy injection that says, you know, if this happens, and we have 45 different policy categories.
• 6:25
  And then that extends to okay, I've got a you know lane chain agent that is doing, you know, actuarial, you know, work automated for us.
• 6:37
  You have to instrument that.
• 6:38
  So we have an SDK to instrument that that that data is also then, you know, the observability and the governance is done through the control plane.
• 6:45
  And then the third piece is we have a governed runtime system that uh allows agents to run in a uh, you know, kind of the entire envelope, the entire runtime is encrypted, has, you
• 6:58
  know, all these different, you know, access points for governance, where like human identity or non human identity is managed and all of that.
• 7:06
  So
• 7:06
  You put that all together, we have what we call the control plane.
• 7:09
  Everything that could possibly happen around agents is connected.
• 7:12
  You have the governance or the observability, and then you have the governance that can then, you know, is what um, you know, kind of the rest of the org, not just the engineers,
• 7:21
  can can kind of log into and and use to, you know, control things.
• 7:26
  Yeah, so how unique is it to each organization?
• 7:30
  You talk about lots of different policies and so forth.
• 7:32
  Does does a company need to understand what it needs for agent governance in order to configure it from
• 7:38
  it the the cool thing about how we did it is like
• 7:45
  an executive, right?
• 7:46
  So a business owner, right?
• 7:47
  Not an engineer, comes in and they look at their they look at their their, you know, the line item on their PL and it's like they go to their CFO, like, whoa, where what was that?
• 7:57
  Right.
• 7:57
  And then they're like, it's like, we spent a lot of money on on, you know, open AI last month, right?
• 8:03
  It's like, okay, cool.
• 8:04
  I want to control cost.
• 8:05
  We have, you know, in in Waxle, we have this thing called a uh policy pack where it's like,
• 8:11
  Somebody who is a non-business owner can say, hey, we need to implement these policies.
• 8:15
  And then an engineer can then scope them down.
• 8:17
  So maybe there's a tool or a workflow or a a certain class of agents or a user set, these kinds of things.
• 8:22
  So they can scope it down and make it a little bit less, you know, every single agent shouldn't be able to spend more than this amount of money, right?
• 8:29
  Which I think becomes problematic when you have millions of different agent executions.
• 8:34
  So, so we've built it so that there's kind of objective overlays and then there's
• 8:39
  you know, security framework and and compliance framework overlays, right?
• 8:43
  We've got like a a NIST pack and an OWASP LLM pack, right?
• 8:47
  So I think the way we've tried to architect this is the non engineers can be intent first in the platform.
• 8:57
  The engineers can get, you know, all the kind of, you know, deep, deep, deep, you know, tool call agent, user group, you know, audit trails, all that kind of stuff if they need.
• 9:10
  What is it you mentioned a couple of times the engagement with non engineers, both the in your own team and and in the customers.
• 9:16
  What what does it take to to build something that addresses the needs of those groups?
• 9:22
  I mean, anybody who's built software products for people, right?
• 9:27
  It's a lot of iteration and a lot of like, you know, conversation and and what what's important and that kind of thing.
• 9:32
  And and one of the cool things now, and this isn't the first product I've ever built.
• 9:38
  One of the cool things now with AI is it's such an important piece of the puzzle for companies, right?
• 9:44
  Like there's board pressure, there's market pressure, right?
• 9:47
  It is it's something that has to get done.
• 9:50
  And I think that
• 9:52
  When we when we're in these conversations, we're getting a lot of feedback about, you know, this is how I look at the world, right?
• 9:58
  And it's like, okay, cool.
• 10:00
  We can translate the this data and and what we've seen is is these really cool conversations with customers that say, This is this is kind of what I'm facing.
• 10:09
  Awesome.
• 10:09
  Well, here's a custom dashboard for that.
• 10:11
  Right.
• 10:12
  And and that allows people to kind of short circuit needing to learn an entire concept of agenda governance, which by the way, changes every day, right?
• 10:20
  Like we have a
• 10:21
  a lab that's running, you know, a thousand agents a day on all these different frameworks.
• 10:26
  So like if you think you know what it is, wait a day, right?
• 10:31
  W what are the things that the the customers, the perspective customers come to you with most?
• 10:35
  You you mentioned that the cost issue is one thing, but what are the other challenges?
• 10:39
  Yeah, I think cost is cost is where people start.
• 10:42
  I think it's the the easy place to start.
• 10:44
  Um, but then kind of uh with these on machine, you know, cloud co work, cloud code, codex, these kinds of things, there's a a big concern about, you know, are we exfiltrating RIP?
• 11:00
  Are we exfiltrating PII?
• 11:01
  Uh does cloud co work?
• 11:06
  Or Claude Coates somehow get around the the kind of you know role-based access that I have implemented in my company.
• 11:13
  Um and so uh I was talking to a chief security officer the other day, and and there's this like concept of like, I almost don't want to know because once I know, right, there's
• 11:26
  gonna be a lot of work involved.
• 11:27
  And and so I think it where a lot of the work right now is starting to happen and needs to happen is understanding that Claude
• 11:36
  Code and cowork and all these tools are super powerful, but there needs to be the layer that we already have when you think about like email and and just connecting so connecting
• 11:47
  an app to your Microsoft O365 account gets admin permission.
• 11:52
  So you have MCPs that people are just adding into their, you know, agents.
• 11:56
  And it's like, are do we know that those tools are are actually trustworthy?
• 12:01
  So are you fingerprinting them and and these kinds of things?
• 12:03
  So so I think there's this external agent.
• 12:06
  piece that is where most companies are starting.
• 12:09
  Uh I think the the further ahead companies or the kind of more like data science driven companies are are, you know, okay, I've got this, you know, eight, eight agent kind of
• 12:23
  fleet that works together to solve one problem.
• 12:26
  How do I, you know, use something that's better than like a a, you know, the normal APM, like a datadog or something, to really see
• 12:34
  how those agents are, you know, we call it lineage, how they're all communicating with each other.
• 12:39
  But I think the real thing that we need that organizations are worried about and and, you know, are focused on with us is that, you know, what's on my employees machine and what,
• 12:52
  you know, what kind of attack surfaces is that, you know, laying out for people.
• 12:59
  Yeah, and you alluded to some of this already, but can you say a little bit more about how that agent governance process is different from what they might already be doing, either
• 13:07
  for for data governance or or ML ops or observability or things like that?
• 13:12
  Yeah, um it's
• 13:16
  The the funny thing is like there's been a lot with like AI governance and prompt level governance and and all of this and AI gateways and all this, but but where things start to
• 13:25
  explode in people's faces is that say you you know we've got an enterprise open AI contract, we know that the data that, you know, uh is being sent to open AI is private, at
• 13:39
  at least that's what they attest.
• 13:40
  Um but when that comes back with a with a
• 13:44
  Like chat GPT or something like this, that that comes back as text or something that that that the user interacts with.
• 13:50
  That's fine.
• 13:51
  That's like, okay, cool.
• 13:52
  We can, we can, we know that that flow is is probably safe, right?
• 13:57
  Now, did the person put, you know, my customer's username and password and and you know, address and social security number in it?
• 14:06
  That could be problematic.
• 14:07
  But if we've got some level of, you know, okay, are we using a private LLM?
• 14:11
  That that kind of AI governance is good.
• 14:13
  The problem.
• 14:15
  though with that agentic governance looks to solve is basically that model is telling an application what to do on that machine.
• 14:26
  That is a whole level of of you know kind of complexity, right?
• 14:31
  That is very difficult for any of the tools that are currently sitting on on people's, you know, machines to to actually intercept before something bad happens, right?
• 14:41
  And uh that's that's where we're seeing
• 14:44
  You know, data exfiltration.
• 14:45
  We just saw a supply chain attack in NPM where like people are just have clawed code, you know, downloading stuff onto their machine that they've downloaded 9,000 times and they
• 14:56
  didn't check that, whoa, you shouldn't download that today.
• 14:59
  And how what tool in in anybody's tool shed right now solves that if you're not specifically, you know, focused on agenda governance?
• 15:09
  Mm-hmm.
• 15:10
  And how do you solve it?
• 15:11
  Given that these are non deterministic tools, there is this agent interaction problem that's out there.
• 15:18
  So we believe that when it comes down to it, a policy, whether it's a HR policy or a spending policy, whatever it is, there becomes a a level of binariness to it, right?
• 15:31
  So can you or can't you do that?
• 15:33
  And that's how we see policies need to work.
• 15:36
  And so abstractly, our goal is to find in every policy category that we work with, you set rules.
• 15:45
  And then our goal and and how we've
• 15:47
  structured our systems is to find the deterministic invariance of that particular thing that's happening.
• 15:54
  So uh Cloud Code has tools, for example, right?
• 15:58
  So if it's gonna do a, you know, if it's gonna run a a bash script, you know, and make an API call or something, it's gonna call that particular tool.
• 16:07
  And then that tool is going to have inputs.
• 16:09
  And so you can intercept all of that, right?
• 16:11
  And so now you can evaluate those.
• 16:13
  And you can say yes or no.
• 16:15
  And you have to do it fast, or the user experience sucks.
• 16:17
  And then, you know, people start to um, you know, try to bypass governance, which is the age-old, you know, that's what everybody tries to do in every other type of governance.
• 16:26
  So we need to make sure that that doesn't happen.
• 16:28
  And so, so it's rules and then find the invariants of of something that happens.
• 16:33
  These are they feel like magic and they feel like black boxes, but they're not, right?
• 16:37
  There, there are things that that you know that you can.
• 16:40
  And then once you find those seams and those surfaces, now you can start to inject governance at different parts, you know, before, during, and after, right?
• 16:49
  You can, you know, uh inject kind of long-term, you know, budget or long-term bias or or these kinds of you know, governance because you have all of that data.
• 17:00
  Um, and so yeah, it's it that's to me, that's the most fun part of of looking at any of this is it's like finding how do you how do you, you know, get your
• 17:10
  Get your finger in the crack as you're as you're, you know, uh trying to scale the wall of governance here.
• 17:17
  Yeah, what was the most challenging aspect for you to build?
• 17:22
  Uh Claude Cowork runs on virtual machines and so so do a lot of these.
• 17:28
  So that's really difficult because they've kind of made it into a you know, this like uh right self contained thing.
• 17:37
  makes it more secure at some level, at least more limited.
• 17:41
  Well, you you think, right?
• 17:43
  But the problem is it still can, you know, with a virtual machine, you can still mount a a file starter, right?
• 17:49
  So it still can go get files from a machine, right?
• 17:52
  So it still can do that, and then it can grab that and it can send it to to something.
• 17:56
  So it's like, you know, it in a lot of ways it's it's more dangerous than something like Claude Code, that clawed code can still, you know, can run bash scripts and stuff, but you
• 18:07
  you have hooks, you have all this stuff that you can so
• 18:11
  So with clo cowork, we've actually built tooling for machines on Mac and Windows that that can kind of interact with the different, you know, components of co work on the machine to
• 18:25
  to you know do that.
• 18:26
  But yeah, cowork is the coolest.
• 18:30
  And what the the funniest part of that is like cowork is used by the least technical people in the company.
• 18:37
  So cowork could say, I'm gonna do this thing, and it's like
• 18:40
  all this, you know, gobbly gook, you know, command stuff.
• 18:44
  And somebody's like, I guess so.
• 18:46
  Accept.
• 18:47
  Right.
• 18:47
  And then it does it.
• 18:48
  That should be intercepted.
• 18:52
  You've talked a few times about about policies.
• 18:54
  How much do organizations even understand what their policies are or or more broadly what their risk tolerance is?
• 19:02
  Because obviously there's some level of trade off here.
• 19:05
  Yeah.
• 19:05
  Uh what's funny, like risk tolerance, uh I think we're you know, there's like the tur the the concept of like marginal gains, right?
• 19:16
  We're we're like in the time of like maximal gains, right?
• 19:19
  There there are no trade-offs right now, right?
• 19:22
  It's like get get policies in place, right?
• 19:24
  Get cost policy in place, data access policies in place.
• 19:26
  You're not gonna make any trade offs.
• 19:29
  They're gonna run milliseconds slower, but you're gonna feel a lot better, right?
• 19:32
  I think
• 19:33
  When we look at risk profiles, that's something that Waxel does, is is each policy category shows we call it blast radius, right?
• 19:41
  So if this happens, here's what's going to happen in your company.
• 19:44
  And we we rate the kind of, you know, here's the things that are generally should be looked at.
• 19:50
  So as you come in, you you kind of had this like boilerplate, right?
• 19:54
  Here's here's what good governance looks like in in an agentic fleet.
• 19:59
  But then as you have your agents running.
• 20:03
  Waxel basically says, Hey, this is an ungoverned database.
• 20:08
  You know, you just made a an ungoverned, uh, raw Postgres query.
• 20:15
  Don't do that anymore, right?
• 20:16
  Here's the policy to to to you know create and you know put it in place.
• 20:23
  Um, one of the challenges is agents can spawn sub agents.
• 20:27
  Yeah, and then you get this this fan out.
• 20:30
  How do you deal with that challenge?
• 20:31
  it it is irresponsible to deploy something like that without without having the understanding of how to control that, right?
• 20:40
  And the way we look at this is um we we we call it agent lineage, right?
• 20:47
  So you have parent, children, siblings, the you know, generally speaking.
• 20:51
  Um but then you need a way to ensure that that that kind of identity, you know, lineage
• 21:00
  Is not lost across that.
• 21:03
  And so that's that's really where we use a lot of you know runtime kind of um there's like a cryptographic element to it, right?
• 21:10
  Where things are stamped, where they're running.
• 21:12
  So, you know, if it's not in the actual code, it's it's from a runtime environment, right?
• 21:18
  So you can start to you there needs to be defense and depth around that because that if you don't have that, then you can't fire a kill switch.
• 21:26
  Kill switches are the you know the thing that
• 21:28
  you know, say something just spawned 20 agents and is iteratively spawning agents, you need to be able to kill that whole lineage in one one click of a button, or you're gonna
• 21:38
  have a big problem.
• 21:39
  You need to start shutting down cloud resources, all that kind of stuff.
• 21:42
  So uh lineage and defense in depth on on that, uh, I can say that's one of the unsung heroes of what we've done because that is not a fun thing for any developer to try to, you
• 21:57
  know, build that.
• 21:58
  You know, themselves.
• 22:00
  Yeah, but as as you say, it's i i it's a really critical thing in this agency world.
• 22:06
  Um well, so broadly, you know, there there are people that focus in more on that identity piece, that that fundamentally the key challenge is identifying and observing ages, the
• 22:17
  people who focus more on the security piece uh and other aspects.
• 22:21
  how how do you look at what's what's really the core of agent governance?
• 22:27
  So
• 22:29
  The problem is like, you know, you've got you've got some walled gardens springing up, right?
• 22:35
  So you got ServiceNow, you know, and I think they just launched something cool with NVIDIA.
• 22:40
  I haven't looked into it too much.
• 22:41
  I think they're calling it control tower, which is awesome.
• 22:43
  But ServiceNow is this walled garden.
• 22:44
  Then you have Agent Force, walled gardens.
• 22:46
  Then you have Claude putting out, you know, this different stuff.
• 22:49
  And then you've got 9,000 uh agent frameworks and new ones popping up every day.
• 22:55
  And you've got different, you know, vector databases that you can use in all of this.
• 22:59
  So the problem is um if you if you try to you know go vendor locked, right?
• 23:09
  Then you you lose all this beauty of what happens in AI, right?
• 23:13
  Because there's always something that's cool that's happening in AI that you should be, you should have somebody on your team looking at that.
• 23:19
  You know, new blog article comes out, you see it on LinkedIn, Twitter, whatever, like go install it.
• 23:25
  Let's go, let's build it.
• 23:27
  So, so then if you've if you
• 23:29
  Focus on uh, you know, okay, I'm gonna secure things at, you know, for what's in this moment of time.
• 23:36
  And I I built this like security for this moment of time.
• 23:40
  And that's only for this set or that or that.
• 23:43
  I think you're not you're not future-proofing the infrastructure.
• 23:47
  So the way we see it is like have the overlay, have everything plugged in, make it easy to plug in.
• 23:52
  And then over time, what we're what we're doing is partnering with the security companies, partnering with these, you know, different companies.
• 23:58
  Because you have to have the overlay that everything can can bubble up into so that you have that single pane of glass that, okay, I have these agents over here, these agents
• 24:08
  over here.
• 24:08
  And then, you know, my dev team is about to push a whole new class of agents that I gotta like see what was happening and then build the policies before they, you know, go out the
• 24:17
  door.
• 24:17
  So I think if you're building a a a kind of point solution right now, it's kind of that whole like you can see a
• 24:27
  uh what's it like you can see an electron either where it is or how fast it's moving, but you can't see both at the same time.
• 24:32
  I think that's what we've got going on in AI, right?
• 24:34
  So we're trying to say, Go build the entire, you know, um the capsule that all my stuff is gonna run in.
• 24:41
  And then you can start doing cool stuff with it, you know?
• 24:46
  What about the shadow agent problem where organizations don't even realize what someone's deploying?
• 24:52
  Yeah.
• 24:52
  Uh so I I think that's that's like that that is the uh craziest problem right now because it's like on one hand, somebody finds this cool thing that the company doesn't know about.
• 25:07
  That should be like you should they should get a cake, right?
• 25:10
  And we should all clap because that's awesome.
• 25:12
  Thank you for trying to make my company better, right?
• 25:15
  And then on the other side it's like, whoa, whoa, whoa, but what is happening with this, right?
• 25:19
  Um
• 25:21
  And so what what we've built is uh on machine apps that that you know are are looking at the the kind of what's going out from the the network and are they a are you know we have
• 25:33
  a catalog I think of like fifteen thousand different uh API URLs and we're constantly building that.
• 25:40
  So it's like, okay, is there API are are there calls coming from this machine that are not, you know, part of the governed flows and and part of the governed agents?
• 25:50
  And then that gets brought to an admin's attention and then they can they can, you know, basically turn those turn those off.
• 25:56
  So so kind of classic API gateway, but at the machine, um at the machine level, not at like the firewall or or network level.
• 26:06
  Mm-hmm.
• 26:07
  And you mentioned kill switches.
• 26:10
  how is it possible to shut something down once it's in deployment, especially if, you know, there's there's child agents and so forth?
• 26:20
  Yeah.
• 26:21
  So the uh the old way of doing this was you just turn off the cloud resource, right?
• 26:26
  Just turn off the machine.
• 26:28
  It's like so so I but but that's problematic, right?
• 26:33
  Because you you you know, sig kill, everything goes away.
• 26:38
  So your audit trail is gone, all the cost data is gone, everything is gone, right?
• 26:43
  ah and so the way we see it is uh, you know, this is where like
• 26:50
  Protecting state, like agent state at all times, right, is the most important thing.
• 26:57
  So if the agent's progressing, it's creating, you know, it might be accessing different data, you know, uh resources.
• 27:05
  It might be, you know, what we talked about generating cost, all of this.
• 27:08
  There might be intermediate work products that are still salvageable, right?
• 27:12
  So it might have written a blog article but didn't get to the uh, you know, place that it, you know.
• 27:19
  checked all the sources or something, right?
• 27:21
  Okay, we shouldn't throw that away, right?
• 27:24
  So what you have to do is you have to to mi uh protect the state of the agent at all costs, which means you have to have you what we call a uh agent envelope, right?
• 27:35
  That you know everything is kind of hitting that envelope.
• 27:39
  It's not hitting the actual functions that are running.
• 27:41
  Like if you, you know, put the the electron microscope on it.
• 27:45
  And so so
• 27:49
  The uh kill switch comes into the envelope, it's then going to the envelope is then going to manage the shutdown of the of the actual agent.
• 27:59
  Um and the nice thing is uh it once you have the infrastructure and the runtime sorted, this becomes a much less challenging issue, especially if you're you're managing the kind
• 28:11
  of agent lineage and all of that.
• 28:13
  But if you're just running like
• 28:14
  raw lane chain, you know, or or these different, you know, agent frameworks on like a a uh celery task or something, that kill switch is gonna you're gonna just lose all the data.
• 28:27
  That's problematic when you think about like, well, I've got a HIPAA auditor.
• 28:30
  I've got a, you know, all these different things, right?
• 28:32
  You've got to have that data preserved.
• 28:34
  So that's kind of the the kill switch in theory, turn off the machine.
• 28:39
  In practice, that doesn't fly.
• 28:41
  You need to have something very graceful.
• 28:43
  Um
• 28:44
  That's very protected and and slow.
• 28:49
  And going forward, what do you think are the the next challenges, um risks, dangers we're going to see uh with agents?
• 29:00
  Biggest risk is that people don't trust them and the whole concept slows down greatly.
• 29:07
  Um I think the the risk of agents, we know what we know what they are, right?
• 29:14
  Theoretically, right?
• 29:15
  Cost and data access, and it could do something.
• 29:18
  You know, you had mythos breaking out of its harness, right?
• 29:21
  That would be a good idea to just uh send a sick kill to the process on the machine, right?
• 29:26
  They like it, there's not that's not real, right?
• 29:28
  They just didn't.
• 29:30
  you know, they just didn't build their harness, right?
• 29:32
  Um, so it's like I think the the biggest pro the biggest risk with agents is that companies don't get to see the value of the agent because they don't have the the
• 29:44
  governance uh infrastructure.
• 29:46
  Every single technology that we've ever put in place, right, has always brought inherent risks.
• 29:53
  cloud infrastructure created a a whole attack surface, right?
• 29:57
  But we adopted it like crazy and and now, you know, it's a pretty it's a pretty secure world.
• 30:03
  Obviously there's always people trying to break into it.
• 30:04
  So yeah, I I think that that's a bigger risk than, you know, any one thing that, you know, an agent might be able to do.
• 30:12
  Mm-hmm.
• 30:13
  And then finally, how do you see this landscape of governance providers around agents evolving?
• 30:18
  You you talked about some the value of a a a general purpose layer versus the walled gardens, but what do you see as the future of the space?
• 30:27
  I think that there's going to be so much parody.
• 30:31
  Like this week I you know, I use Cloud Code a lot.
• 30:34
  And then uh Cloud Code started, you know, kind of being weird.
• 30:38
  So I I spun up Codecs for the first time.
• 30:41
  And so now I'm using Codecs.
• 30:43
  So I think there's so much model parity, right?
• 30:46
  I think there's so much provider parity that a a well constructed organization is going to have the kind of
• 30:56
  workflows internally to say this model is right for this or this provider is right for this and this provider's right for that.
• 31:02
  And so that's why I believe that over time, uh it it's kind of crazy to think that a company would commit to a walled garden agentic infrastructure.
• 31:13
  And so I think that's where and you already see the explosion of observability companies right now, which observability you can't govern what you can't observe.
• 31:22
  So I think there's going to be movement.
• 31:25
  of those types of companies into governance, I hope, right?
• 31:27
  Because, you know, it'd be nice to have have some, you know, analogs here.
• 31:32
  And and um so I think the the the general purpose governance layer, I think is what's going to win because that's that's what that's what the the big money in the space is
• 31:45
  going to kind of ask for, right?
• 31:47
  Let me have an opportunity to compete.
• 31:49
  You see that with OpenAI puts out five point five.
• 31:52
  Now they're saying
• 31:54
  Let's get all the cloud code users, right?
• 31:56
  So they're not gonna want walled gardens all over the place.
• 31:58
  Otherwise, you know, they're they're, you know, we go back into this like year-long lockdown and all that kind of stuff.
• 32:05
  So yeah.
• 32:06
  General general purpose, I think, is gonna be what wins and then who can plug the most kind of accoutrements into the different, you know, pieces.
• 32:16
  Great.
• 32:16
  Well Logan, thank you so much.
• 32:18
  We gotta wrap up, but really appreciate your time in the conversation.
• 32:21
  Thanks, thanks Kevin.
• 32:22
  Appreciate it.
• 32:24
  This has been the Road to Accountable AI.
• 32:26
  If you like what you're hearing, please give us a good review and check out my Substack for more insights on AI accountability.
• 32:33
  Thank you for listening.
• 32:37
  If you want to go deeper on AI governance, trust, and responsibility with me and other distinguished faculty of the world's business school, sign up for the next cohort of
• 32:46
  Wharton's Strategies for Accountable AI Online Executive Education Program.
• 32:51
  Featuring live interaction with faculty.
• 32:54
  Expert interviews and custom designed asynchronous content.
• 32:57
  Join fellow business leaders to learn valuable skills you can put to work in your organization.
• 33:03
  Visit execed.warden.upen.edu slash acai for full details.
• 33:10
  I hope to see you there.
• 33:11
  uh