Latest / Herbert Smith Freehills Kramer Podcasts / Cross-examining AI: Liability for AI harms and SRA’s warning notice on AI
Transcript
- 0:08SPEAKER_01: Hello and welcome to the fourth episode of Cross Examining AI, HSF Kramer's podcast on disputes and AI, where we unpack the key developments that are shaping litigation.
- 0:18SPEAKER_01: I'm Camilla McPherson, a knowledge lawyer in our dispute resolution practice with a particular interest in AI.
- 0:24SPEAKER_01: And today I'm joined by banking litigation partner Emma Dees and Will Glassy, a partner in our commercial litigation practice with a focus on professional negligence and professional disciplinary claims.
- 0:34SPEAKER_01: Welcome to you both.
- 0:36SPEAKER_01: Emma's going to start by giving us an overview of the UK JT statement on liability for AI harms.
- 0:41SPEAKER_01: After that, Will's going to be taking us through the SRA's recent warning notice on AI and talking about the first case from the Solicitors Disciplinary Tribunal where a lawyer has been struck off for misuse of AI.
- 0:54SPEAKER_01: Emma, following a public consultation earlier in the year, the UK Jurisdiction Task Force recently published the final version of its legal statement on liability for AI harms under English law.
- 1:06SPEAKER_01: Can you start by reminding us what the UKJT is and what it aims to do?
- 1:10SPEAKER_00: So the UKJT is an industry-led body that in essence promotes the use of English law as the jurisdiction of choice for technology and digital innovation.
- 1:20SPEAKER_00: It has previously published legal statements on crypto assets, smart contracts, and digital securities.
- 1:27SPEAKER_00: These statements don't create new law.
- 1:29SPEAKER_00: They're intended to be authoritative statements on how existing law applies to new areas.
- 1:35SPEAKER_00: So what's the focus of this latest statement?
- 1:38SPEAKER_00: It basically grapples with one of the most difficult questions in the AI space.
- 1:42SPEAKER_00: And that's whether and in what circumstances those who have not set out to deliberately cause harm may be liable for harms resulting from the use of AI.
- 1:52SPEAKER_00: So the focus of the statement is on tortious liability, and within that, most attention is given to negligence.
- 1:59SPEAKER_00: The UK JT says that contract is likely to be the foundation for many and maybe most commercial relationships arising from AI.
- 2:07SPEAKER_00: But where there is a contract, the starting point will be what that contract says.
- 2:11SPEAKER_00: The greater legal complexity is therefore likely to lie in tort.
- 2:16SPEAKER_01: What would you say is the overall message of the statement?
- 2:20SPEAKER_00: So the UKJT's key message is that English law is flexible and has frequently accommodated novel and disruptive technological developments.
- 2:30SPEAKER_00: So the point there is that the law has shown it can provide certainty and predictability in the face of technological innovation and it's therefore broadly well equipped to deal with the question of AI liability.
- 2:41SPEAKER_01: Okay, thinking first about negligence, how does the UKJT say that the duty of care analysis works in an AI context?
- 2:49SPEAKER_00: Essentially, the UK JT say it's a matter of applying established legal principles.
- 2:54SPEAKER_00: So this means establishing foreseeability, proximity, and whether it's fair, just and reasonable to impose a duty.
- 3:01SPEAKER_00: In many AI scenarios, that analysis may be pretty straightforward.
- 3:06SPEAKER_00: Where it gets complicated is likely to be further up the supply chain.
- 3:10SPEAKER_00: For example, do foundation model developers owe a duty of care directly to end users with whom they have no contractual relationship?
- 3:18SPEAKER_00: The statement doesn't rule it out, but this may be one of those areas where for now we just have to wait and see.
- 3:24SPEAKER_01: What does the statement have to say about professionals using AI?
- 3:29SPEAKER_00: The statement's particularly interesting in this area.
- 3:31SPEAKER_00: It says that a professional's duty of reasonable skill and care extends to their use of AI, and that the standard required is likely to evolve as time goes on.
- 3:40SPEAKER_00: So a professional could be found negligent for things like using AI inappropriately, using an unsuitable model, failing to verify outputs, or failing to be transparent with clients about AI use.
- 3:51SPEAKER_00: But the UK JT goes further.
- 3:53SPEAKER_00: It says a professional could be liable for failing to use AI at all.
- 3:58SPEAKER_00: Lawyers are particularly interested in this, of course.
- 4:00SPEAKER_00: And in fact, one of the examples in the statement is of a solicitor failing to advise their client that it may wish to consider some form of AI-assisted tool in document review.
- 4:09SPEAKER_01: What about causation?
- 4:10SPEAKER_01: Does AI create any particular difficulties here?
- 4:13SPEAKER_00: The UKJT say that the standard but for test should generally work in the AI context.
- 4:19SPEAKER_00: And for many claims, the analysis will be, again, pretty straightforward.
- 4:23SPEAKER_00: But again, the statement acknowledges that this gets trickier as you move further up the supply chain.
- 4:29SPEAKER_00: If you're trying to establish that a foundational model developer was negligent, you face the black box problem of perhaps not really understanding the workings of the model or how or why it did what it did.
- 4:41SPEAKER_00: As agentic AI takes off, this may become even more difficult, although expert evidence may be able to help unravel the complexities.
- 4:48SPEAKER_00: We're still at the very beginning of this part of the AI journey, and I think we should anticipate parties looking to push the boundaries of what might be possible.
- 4:55SPEAKER_00: Yeah, I agree with that.
- 4:57SPEAKER_00: What else does the statement have to say?
- 5:00SPEAKER_00: Much, much more than we can cover today.
- 5:02SPEAKER_00: It's a big document.
- 5:03SPEAKER_00: But to pick up a couple of things, there's an in-depth section on liability for false statements by AI chatbots.
- 5:09SPEAKER_00: It also considers a question of whether a developer can be liable when a bad actor deliberately misuses their AI.
- 5:16SPEAKER_00: Finally, there's a nod to the possibility of contributory negligence as a route to reducing damages, with the UK JT taking the view that a non-commercial user of AI would generally be less likely to be found contributory negligent than a commercial user.
- 5:30SPEAKER_00: Although, again, this is all going to depend on the factual context.
- 5:34SPEAKER_01: Okay, so there's a lot in there.
- 5:35SPEAKER_01: What isn't covered?
- 5:37SPEAKER_00: Well, as I said at the beginning, the statement isn't about contract.
- 5:40SPEAKER_00: It's focusing on tort.
- 5:42SPEAKER_00: So economic torts, competition claims, and the interaction between AI and IP rights, data protection, and the use of AI by public authorities are all out of scope as well.
- 5:53SPEAKER_01: Brilliant.
- 5:54SPEAKER_01: Thanks so much, Emma, for that overview of what is a pretty weighty document.
- 5:58SPEAKER_01: Now it's over to you, Will.
- 6:00SPEAKER_01: We've talked before on the podcast about the dangers of AI hallucinations.
- 6:03SPEAKER_01: And I understand that the SRA has now published a warning notice focusing on this and client confidentiality issues.
- 6:10SPEAKER_02: That's right, Camilla.
- 6:12SPEAKER_02: The SRA has received, it says, 42 reports of potential AI misuse.
- 6:18SPEAKER_02: That's in the 12 months to July of this year.
- 6:22SPEAKER_02: And a number of their investigations are ongoing.
- 6:25SPEAKER_02: They cover inaccurate legal citations, supervision failures, and confidentiality breaches.
- 6:32SPEAKER_02: And against that backdrop, the SRA has identified two key areas of concern.
- 6:38SPEAKER_02: The first is false or incorrect information being submitted to the court or included in other documents.
- 6:44SPEAKER_02: So that's the hallucination risk, where AI generates fictitious cases, fictitious references, or factual assertions with no basis.
- 6:54SPEAKER_02: The second is maintaining client confidentiality, and in particular, the risks of entering client data into AI tools that lack the necessary safeguards.
- 7:04SPEAKER_01: So what are the key risks from the regulator's point of view?
- 7:08SPEAKER_02: The way the SRA sees it is that from a client's perspective, relying on fabricated authorities can lead to fundamentally flawed advice.
- 7:17SPEAKER_02: And from a court's perspective, all this causes delay as well as undermining the integrity of the process more widely.
- 7:26SPEAKER_02: And then there's the damage done to public trust and confidence in the legal profession.
- 7:31SPEAKER_01: Okay, so that's the hallucination side.
- 7:33SPEAKER_01: What are they saying about client confidentiality?
- 7:36SPEAKER_02: In short, they say that using public AI tools with confidential client information, quote, will likely breach client confidentiality.
- 7:47SPEAKER_02: And as a result, legal professional privilege may be permanently waived.
- 7:52SPEAKER_02: And this reflects an immigration decision in the upper tribunal earlier in the year, where a lawyer said that he had entered client letters and home office decision letters into open source AI.
- 8:05SPEAKER_02: The tribunal commented that this could breach client confidentiality and could therefore lead to a loss of legal professional privilege.
- 8:13SPEAKER_01: So, what does the SRA say solicitors and firms should actually be doing?
- 8:18SPEAKER_02: The key message from the SRA is that it's the regulated individual using the AI or supervising that user who is responsible.
- 8:26SPEAKER_02: In practical terms, the SRA recommends four things.
- 8:31SPEAKER_02: First, firms have effective governance structures and systems to manage the risks arising from AI.
- 8:38SPEAKER_02: Then, secondly, solicitors should ensure that all case law authorities they submit are genuine and relevant.
- 8:44SPEAKER_02: Third is the importance of effective supervision of junior and non-authorised colleagues.
- 8:50SPEAKER_02: And fourthly, client information is only to be entered into AI systems with appropriate safeguards to protect confidentiality.
- 8:58SPEAKER_02: That last point may be particularly important for in-house solicitors, because AI tools developed by a commercial enterprise may not have been designed with the safeguards required for legal work.
- 9:11SPEAKER_01: All right.
- 9:14SPEAKER_01: Do you think it goes far enough?
- 9:17SPEAKER_02: It goes, it's a welcome step, but it really only addresses two risks at the moment: hallucinations and confidentiality breaches.
- 9:25SPEAKER_02: And these are already well understood by much of the profession.
- 9:30SPEAKER_02: As AI becomes more sophisticated, the range of risks will widen as well.
- 9:36SPEAKER_02: And notably, the SRA hasn't said yet that it's going to amend its handbook, that is, the principles or the code of conduct to regulate AI directly.
- 9:47SPEAKER_02: For now, the SRA's warning notice suggests that they are comfortable that the existing regulatory framework is sufficient.
- 9:55SPEAKER_02: So, for example, the long-standing confidentiality obligation under paragraph 6.3 of the Code for Individuals, or the existing obligations concerning duties to the court under section two of the code for individuals, those haven't changed.
- 10:10SPEAKER_02: The new warning notice doesn't seek to amend or supplement those.
- 10:14SPEAKER_02: It remains to be seen, though, whether the SRA will continue to adopt that position or whether they'll seek to introduce AI-specific rules under the Code of Conduct.
- 10:25SPEAKER_01: You mentioned that the responsibility is firmly on the lawyer to get things right when they're using AI, and that's a neat segue into your next topic because a lawyer has recently been struck off for misuse of AI, and I believe that's in part another hallucination case.
- 10:40SPEAKER_01: Now, we've seen a lot of court judgments about hallucinations that show that the court has a wide range of powers available to ensure that lawyers comply with their duties to the court.
- 10:50SPEAKER_01: The things like public admonition, wasted cost orders, striking out a case, and even contempt proceedings.
- 10:57SPEAKER_01: Seems to me reading of these judgments that referral to the regulator is also pretty standard practice.
- 11:02SPEAKER_01: In some cases, the referral coming from the court, and in some cases the lawyer referring themselves.
- 11:07SPEAKER_01: I guess we now might have some insight into how the solicitor's disciplinary tribunal might respond.
- 11:13SPEAKER_02: Yes.
- 11:14SPEAKER_02: Some of these cases will be trivial and won't call for SRA involvement, but there is a good example of a particularly egregious case in the SRA's prosecution of Mr.
- 11:26SPEAKER_02: Kuma in the Solicitor's Disciplinary Tribunal, which came to a trial and judgment in the tribunal in August of this year.
- 11:33SPEAKER_02: The respondent was a registered foreign lawyer who was facing two allegations of misconduct.
- 11:40SPEAKER_02: The first related to a crime which he'd been convicted for in 2024 for knowingly employing someone without the right to work in the UK.
- 11:49SPEAKER_02: The second, though, related to his use of AI.
- 11:52SPEAKER_02: In defending his conduct of the immigration charge, but not in the court, not in the criminal court, but before the SRA itself, he had filed documents with the SRA containing what the SRA said and the tribunal found were misleading references to legal authorities, basically AI hallucinations.
- 12:13SPEAKER_01: Was this a one-off mistake or did it go further than that?
- 12:16SPEAKER_02: Oh, it went much further.
- 12:18SPEAKER_02: After the SRA had identified the problem, the respondent sent an email admitting that he'd used AI in his first submissions and purporting to correct the errors.
- 12:29SPEAKER_02: The problem was that that email itself was drafted using AI and contained further false material.
- 12:36SPEAKER_02: So having been put on notice of the AI errors, the respondent repeated that mistake rather than taking steps to rectify it.
- 12:44SPEAKER_01: Now I think this is the first time a lawyer's use of AI in legal proceedings has come before the tribunal.
- 12:50SPEAKER_01: How did it approach the case?
- 12:52SPEAKER_02: The solicitor's disciplinary tribunal drew heavily on the decision in Ayundai and Harangay, the landmark judgment of Dame Victoria Sharp, who was then the president of the King's Bench Division on the use of AI.
- 13:06SPEAKER_02: And in Ayundai, she made it clear that lawyers who use AI for legal research have a professional duty to check for accuracy against authoritative sources.
- 13:17SPEAKER_02: The tribunal noted that the president in that case also pointed out that there are serious implications for the administration of justice and public confidence in the justice system if AI is misused, and that every individual providing legal services needs to understand and comply with their professional and ethical obligations when they're using AI.
- 13:39SPEAKER_01: And are there any broader points you think are worth pulling out?
- 13:42SPEAKER_02: Yes, a couple.
- 13:44SPEAKER_02: First, the tribunal confirmed that there's no distinction in principle between misleading material sent to a regulator, a disciplinary tribunal, or a court, the same professional duties apply.
- 13:56SPEAKER_02: Secondly, the tribunal said that this is ultimately about a lawyer's fundamental duty in litigation and to the court as to the accuracy of materials produced to the court.
- 14:07SPEAKER_02: AI was the medium through which the erroneous material was produced in this case.
- 14:12SPEAKER_02: But the same issue could arise in using search engines or where work was produced by someone else for whom the lawyer had ultimate responsibility.
- 14:21SPEAKER_01: And did it make a difference that the respondent in this case was a registered foreign lawyer rather than a solicitor?
- 14:27SPEAKER_02: No, it didn't make any difference that he was an RFL, and it didn't make a difference that he wasn't in practice by the time he was referred to the tribunal.
- 14:36SPEAKER_02: The tribunal said he had been a regulated individual when he provided the services, and he was obliged to comply with the standards of his profession.
- 14:45SPEAKER_01: All right, let's talk about the sanction.
- 14:47SPEAKER_01: The strike-off order was at the top end.
- 14:49SPEAKER_01: How did the tribunal reach that decision?
- 14:52SPEAKER_02: The tribunal were unsparing in their criticism of Mr.
- 14:57SPEAKER_02: Kumar.
- 14:58SPEAKER_02: On the AI allegations, the tribunal found very high culpability, stressing that a lawyer is always responsible for the accuracy of their output.
- 15:08SPEAKER_02: And in this case, the respondent had used AI without giving proper thought to the consequences and failed to take proper steps to ensure its accuracy.
- 15:17SPEAKER_02: The repetition of the misconduct after being put on notice was given substantial weight.
- 15:23SPEAKER_02: Harm was assessed as high, with the tribunal describing it as a cardinal duty of a solicitor not to mislead a court or a tribunal.
- 15:32SPEAKER_01: And crucially, I understand that the tribunal said the AI misconduct alone would have been enough for a strike-off without the separate immigration issue.
- 15:41SPEAKER_02: That's right.
- 15:42SPEAKER_02: The tribunal was clear that it would have imposed the same sanction, the strike-off, for either allegation alone.
- 15:48SPEAKER_02: So the AI-related misconduct was serious, uh, sufficiently serious to warrant the strike-off.
- 15:54SPEAKER_02: And that's a significant marker for the profession.
- 15:58SPEAKER_01: What would you say are the key takeaways for the profession going forward?
- 16:01SPEAKER_02: Okay, well, we'd emphasise three things coming out of the tribunal's judgment.
- 16:06SPEAKER_02: First is the cardinal nature, and that's the tribunal's own expression, of a lawyer's duty in litigation and to the court.
- 16:15SPEAKER_02: Secondly, the tribunal gave substantial weight to the repeated nature of the misconduct, essentially doubling down on AI-generated errors after being put on notice.
- 16:26SPEAKER_02: It's the repetition which made it particularly egregious.
- 16:30SPEAKER_02: The respondent had lacked insight into what he'd done wrong in the first place when it came to corresponding with the SRA about that and repeating his use of AI hallucinations.
- 16:42SPEAKER_02: Thirdly and finally, the tribunal expressly referred to publicly available SRA guidance on conduct in disputes.
- 16:51SPEAKER_02: The bottom line is that lawyers should now be very much on notice of the risks of AI-generated legal research, and ignorance is unlikely to be a defence.
- 17:02SPEAKER_01: Thanks so much, Will.
- 17:03SPEAKER_01: It'd be interesting to see if we get more decisions like this as time goes on and the tribunal works through these various referrals.
- 17:10SPEAKER_01: That's all for this episode of Cross-Examining AI.
- 17:12SPEAKER_01: I'd like to thank Emma and Will for joining me, and I hope listeners have found the discussion helpful.
- 17:17SPEAKER_01: There are links to more information on all of the topics covered in the show notes.
- 17:22SPEAKER_01: Do please subscribe to the podcast and get in touch if you have ideas for topics you'd like us to cover in the future.
- 17:27SPEAKER_01: Thank you and goodbye.