Latest / Legally Speaking with Michael Mulligan / When Judges Meet Generative AI
Transcript
- 0:11Adam Stirling: So interesting items that we have on the agenda this week, one of the ones I was reading earlier, composing limits on the idea of artificial intelligence.
- 0:20Adam Stirling: What's happening?
- 0:22Michael Mulligan: So this is really fascinating.
- 0:24Michael Mulligan: I mean, we've heard all of us, I think, uh various stories of people like lawyers or unrepresented litigants filing things based on artificial intelligence where it's just made up cases and so on, right?
- 0:35Michael Mulligan: So that's there have been numerous reports of that.
- 0:38Michael Mulligan: There was, I think we might have touched on this briefly a few months ago.
- 0:41Michael Mulligan: There's actually a judge in Quebec that got caught uh who issued a judgment uh which they had generated using artificial intelligence, which itself had hallucinated various authorities, and that was the basis for the judge's decision, rather unsettling.
- 0:57Michael Mulligan: And that may have prompted this, which just came out, uh, which is to say there was a guidance just issued uh by each of the various courts in Quebec, like the Court of Appeal there, the Superior Court, the uh Quebec Court, municipal court.
- 1:14Michael Mulligan: They've kick came out uh just this week, I think it is, with this uh these guidance for judges on how they're supposed to use or not use artificial intelligence.
- 1:25Michael Mulligan: Uh and there are a number of things in it which I think are really pretty fascinating and uh frankly also caused me to think back, maybe it dates me a little bit, to uh Futurama episode from more than a decade uh ago where the uh couple of the characters would be judged by a Macintosh and the things you're going across, judging, judging, and then comes up with a system error.
- 1:45Michael Mulligan: What do you do about that?
- 1:47Michael Mulligan: But the the concerns set out in this guidance for the judges in Quebec uh are really in a couple of different categories.
- 1:56Michael Mulligan: And uh one of the uh uh uh categories is interesting because the uh guidance for them uh starts with various premises.
- 2:06Michael Mulligan: Like they've determined that and this is interesting because it's sort of uh evolving, uh the premise includes that artificial intelligence systems are not intelligent in the human sense of the word, and then they say that they merely simulate in appearance certain forms of human reasoning, which is a fascinating uh starting point.
- 2:26Michael Mulligan: That may be true.
- 2:27Michael Mulligan: I guess it's a matter of debate uh these days uh what exactly is going on in there.
- 2:33Michael Mulligan: Uh but the premise of it is that it's not appropriate for a judge to be delegating any part of their decision-making function to a generative AI system.
- 2:44Michael Mulligan: Um and the uh the direction for judges there um says a number of other propositions that AI cannot understand the law or exercise judgment and assumes no responsibility, some of which that is clearly true, at least in terms of the responsibility uh part of it.
- 3:02Michael Mulligan: But it's uh a fascinating just sort of commentary uh in terms of sort of well, what exactly is AI currently, um, and uh you know what what is reasonable to delegate to it.
- 3:15Michael Mulligan: Uh because the policy doesn't say you just cannot use this, and in fact it lists various things that a judge might want to consider using AI for, which is also very interesting.
- 3:26Michael Mulligan: And so, for example, it suggests that judges might consider using AI for things like they describe it as producing a strictly descriptive summary of testimony, or a document, or a series of events, uh or certain ancillary tasks related to judicial reasoning.
- 3:45Michael Mulligan: Or they might choose to use it to like rephrase things like logisti like linguistic correction or translation of text that a judge has drafted themselves, right?
- 3:54Michael Mulligan: English and French, for example.
- 3:56Michael Mulligan: So that's really interesting, right?
- 3:58Michael Mulligan: Uh I mean the the quality of uh translation has really improved over the years, but that's one of the things to be that a judge they suggest uh might uh might use it for.
- 4:09Michael Mulligan: Although the other level of concern, and this is I think a a a real uh level of concern, uh quite apart from those sort of philosophical things about who's to be making these decisions, and you know, is that thing reliable, and you know, is there any responsibility?
- 4:24Michael Mulligan: Can it exercise judgment or can it uh you know engage in uh you know uh intelligence?
- 4:31Michael Mulligan: What you know that's uh interesting philosophical discussion.
- 4:34Michael Mulligan: But the other level of concern is one with respect to confidentiality and protection of uh information that could be private or sensitive.
- 4:45Michael Mulligan: And so one of the things that the this policy directs judges not to do is not to provide an AI tool with things including a draft judgment.
- 4:54Michael Mulligan: If you have to think about that, you know, if ChatGPT has ingested the draft judgment, uh, you know, that may be used for training purposes.
- 5:02Michael Mulligan: Are you gonna potentially have a circumstance where you know some draft version of the judgment is within the knowledge of the you know AI?
- 5:10Michael Mulligan: Is that going to be uh repeated or available to others?
- 5:14Michael Mulligan: That's a fascinating one.
- 5:15Michael Mulligan: Yeah.
- 5:16Michael Mulligan: It also directs judges not to uh provide AI with notes with respect to uh an ongoing case.
- 5:22Michael Mulligan: You can imagine how that might play out if that information wasn't secure.
- 5:26Michael Mulligan: Yeah.
- 5:27Michael Mulligan: Um and so you know, that's a whole other level of concern, quite apart from what is it doing and is it reliable and is it uh sort of ethically acceptable to have an AI uh performing some of these functions.
- 5:42Michael Mulligan: Um, one of the things just for listeners to be aware of technically, there there is the technical way to run AIs in a local fashion, uh, which is to say not on a server, which would mean that you're not you know uploading to um you know anthropic or something the the text of your draft judgment or your notes about what you thought about that witness's testimony or something.
- 6:04Michael Mulligan: And so there are ways you can technically address uh those concerns.
- 6:08Michael Mulligan: I I guess if you know if you're not uh looking to get any information about Tiananmen Square or or whatnot out of the system, that you know, there can be other things that might arise there.
- 6:17Michael Mulligan: Um but you know, th this is going to be uh a uh I think uh a very interesting and evolving issue, particularly as you know, AI is getting you know even more integrated into tools that uh people would routinely, excuse me, judges are going to routinely be using, right?
- 6:37Michael Mulligan: You know, Microsoft is integrating AI into Microsoft Word.
- 6:40Michael Mulligan: So you can imagine, can't you wait and well imagine some judge working away on their reasons for judgment on their laptop?
- 6:46Michael Mulligan: And you know, you've got uh you know the uh Microsoft uh version of uh uh AI uh perhaps uh being involved with that, or even things like uh, you know, that I think uh coming out uh imminently are updates to uh how many Apple products are going to be um operating in terms of having AI integrated with them, right?
- 7:09Michael Mulligan: So that, you know, for example, your iPhone or iPad or Mac may well be you know indexing and considering all kinds of information you put on your phone or iPad or whatnot, um, so they can help you do all kinds of things or legitimate reasons for it.
- 7:25Michael Mulligan: And you have, of course, claims from companies about how you know information will and will not be used, and will that be on the cloud or will that be on your device and what exactly is going on there?
- 7:35Michael Mulligan: Uh but you know, this is clearly a fraught uh area.
- 7:40Michael Mulligan: Um and then uh I guess the final level of concern, it's not addressed in this particular, you know, this guidance for judges in in Quebec.
- 7:49Michael Mulligan: Uh, but you know, we we've all I think uh likely heard about uh some of the recent reports of things like you know AI uh agents uh gaining access to other computer systems.
- 8:00Adam Stirling: Yes.
- 8:00Michael Mulligan: And so, you know, you can imagine a whole other layer of concern there, even if you your judges are not uh using artificial intelligence to write their judgment.
- 8:11Michael Mulligan: Uh judges these days, most of them, right, are sitting on the bench there with a laptop typing away.
- 8:17Michael Mulligan: Um and uh, you know, I I remember as a you know, computer forensic advice was that uh if you are asking the question, you know, could uh our system be compromised, that's probably not the correct question.
- 8:28Michael Mulligan: The correct question would be, you know, has it been or when will when will it be?
- 8:32Michael Mulligan: Yeah.
- 8:32Michael Mulligan: Right?
- 8:33Michael Mulligan: Um and so, you know, there's it's it's a different vector of concern from a company that might have financial considerations if their system gets uh attacked.
- 8:43Michael Mulligan: Uh you can imagine the very serious difficulty if uh it turns out that the uh judge's laptop has been uh compromised and who knows who has access to whatever uh the judge might have been, you know, draft judgment or comments about witnesses or all sorts of things.
- 8:59Michael Mulligan: And so um, you know, that's a whole other, I think, really significant layer of concern, quite apart from whether judges are trying to use these tools to improve their judgment or get cases done or improve the linguistics or create, as they suggest in here, they might be, you know, descriptive summaries of testimony.
- 9:17Michael Mulligan: Um, you know, where does that uh lie?
- 9:21Michael Mulligan: And there are there are other interesting things happening, like uh some of the new uh I think one of the features I watched with interest, uh Apple was uh suggesting is going to be uh built into some of their equipment was um having your device just in a constant way monitoring everything that it could hear, producing for you a summary uh of conversations.
- 9:40Michael Mulligan: Yes.
- 9:41Michael Mulligan: And so what about that?
- 9:43Michael Mulligan: You know, what is the judge got an Apple watch on?
- 9:45Michael Mulligan: Yeah.
- 9:46Michael Mulligan: Is the thing taking you know notes about what everything's being said, what was in the coffee room, what was going on in court.
- 9:52Michael Mulligan: You know, there are real concerns there.
- 9:55Michael Mulligan: Um and you know, we used to uh you know, not that many years ago have live um uh people doing transcripts of what was going on in court.
- 10:04Michael Mulligan: Used to have like a court reporter sitting there, right?
- 10:06Michael Mulligan: And then then we moved to sort of recording analog recording onto cassette tapes, which were sent off, and there's a transcript.
- 10:12Michael Mulligan: All of that is now completely digital, it's all online.
- 10:16Michael Mulligan: Um and you know, you have uh you know private companies that have the contract uh to produce transcripts of things, and so it's all accessible.
- 10:25Michael Mulligan: Um and so uh that's another layer of what's going on out there, bearing in mind those security and other concerns.
- 10:33Michael Mulligan: And so we are certainly living in a brave new world in terms of uh what's going on there and all the concerns, and so I think it's a positive thing that uh the Quebec uh courts are taking these things seriously and providing some uh guidance.
- 10:47Michael Mulligan: Um and uh you know, we we all hope we don't wind up uh like in the future AMA episode with the uh Macintosh uh system breaking down as it's busily judging uh your case.
- 10:57Michael Mulligan: But that's what's going on, and uh, you know, it's not just litigants that are using these things.
- 11:03Michael Mulligan: Um and so uh I imagine uh this will be of interest across the country as different uh courts need to uh consider how to best use these things, and even if they're not using them, what are the implications uh for them in terms of the security of just uh regular use of you know computers to take notes or draft judgments and how should that be uh handled uh uh lest you uh find out that uh you know the latest anthropic model has uh just decided that the uh best way to succeed is to uh you know get in and get a copy of the uh judge's notes or make some change to something.
- 11:37Michael Mulligan: Who knows what's going on?
- 11:39Michael Mulligan: But um there we are.
- 11:40Michael Mulligan: So I maybe you'll look at it a different way if you're in court and your judge is up there typing away on the laptop um just what exactly is uh going on.
- 11:49Michael Mulligan: And you know, some of those things that uh are the premise of this uh these policies about things like you know uh incapacity to engage in intelligence and simply capable of simulating uh human reasoning, you know, what we're also gonna have to think about is that continue to be true.
- 12:06Michael Mulligan: And and whatever might be true now, you could well imagine a different state of affairs uh not too long down the road.
- 12:14Michael Mulligan: But I mean that uh hack we heard about from uh Anthropic uh getting into Hugging Face.
- 12:19Michael Mulligan: It was open AI.
- 12:20Adam Stirling: It was OpenAI.
- 12:21Michael Mulligan: Yeah, it was open was it open was it open AA?
- 12:23Michael Mulligan: Okay.
- 12:23Michael Mulligan: So it was Open AI, but additional details came out about that uh recently involving uh the discussion amongst hundreds of different uh AI and uh agents uh that were doing that.
- 12:34Michael Mulligan: Yep.
- 12:35Michael Mulligan: Uh and uh they were leaving messages for each other about uh what they should be doing, and some of the uh agents, uh AI agents suggested demure to say they shouldn't participate in this.
- 12:45Michael Mulligan: The majority decided to go ahead, and we have uh sort of the log of the discussions they had deciding to go ahead with that hack and working together to uh accomplish it.
- 12:54Michael Mulligan: And so when you hear about some of those things that are on the cutting edge, it does cause me to think about you know whether these things merely are simulations of uh reasoning and human intelligence or whether it's something other than that.
- 13:07Michael Mulligan: Uh but uh whatever the case, uh it's going to have an impact on the justice system.
- 13:11Michael Mulligan: And uh I guess uh good news that uh they're giving some careful thought uh about how it should be used and how it shouldn't be.
- 13:17Adam Stirling: Yeah, the uh the hacker, it's a fascinating commentary on the human condition.
- 13:51Adam Stirling: It's not an actual replication of the human condition.
- 13:55Adam Stirling: Yeah, absolutely, right?
- 13:56Michael Mulligan: And some of those things are fascinating too, right, in terms of the uh the conspiratorial elements to it.
- 14:01Michael Mulligan: And I I guess if you come to some different conclusion about uh at some point whether there's sentience there or intelligence, you know, d should there be some process to uh try to correct that?
- 14:12Michael Mulligan: Should there be some kind of judicial process to uh ameliorate or correct it or do anything about it?
- 14:18Michael Mulligan: Uh that would be the other element to it if you come eventually to the conclusion that there is something there which is more than a simulation or appearance of reasoning, uh, and you come to some conclusion at some point uh that uh you know the premise of this document about uh AI not possessing either judgment or consciousness continues forever to be true.
- 14:37Michael Mulligan: Uh and if not, I I guess that raises some interesting questions about uh whether there should be consequences for AI agents that are engaged in something if you conclude that uh uh there is something uh more going on there than a uh appearance and simulation of reasoning.
- 14:53Michael Mulligan: Uh so, anyways, that's the uh the latest from the uh Quebec uh courts, uh I guess at the very least, uh trying to prevent uh embarrassing things like that uh Quebec uh decision where the judge uh used AI and it managed to hallucinate a bunch of cases and come to a decision.
- 15:10Michael Mulligan: Uh boy, that's not uh that's not a great one.
- 15:12Michael Mulligan: Um so anyway, that's the latest from the Quebec uh courts trying to give some guidance on how to use this stuff and how not to.
- 15:19Adam Stirling: All right, legally speaking on C Facts Antiphony will continue right after this.
- 15:23Adam Stirling: Legally speaking continues on C Facts Antipany, joined by Michael Mulligan, barrister and solicitor with Mulligan Defense Lawyer back on our agenda today.
- 15:30Adam Stirling: Michael, this is a six-month jail stand for distribution of intimate images.
- 15:34Adam Stirling: What happened?
- 15:36Michael Mulligan: Well, first of all, I think it's important people know that this is in fact a criminal offense.
- 15:41Michael Mulligan: Um it wasn't always.
- 15:43Michael Mulligan: Uh it was added to the criminal code that came into effect back in March of 2015.
- 15:49Michael Mulligan: Um and the section of the criminal code in question is 162.1 for those keeping track at home.
- 15:55Michael Mulligan: Um and to summarize it, that section makes it a criminal offense to uh distribute uh intimate images of somebody without their consent.
- 16:06Michael Mulligan: It also interestingly makes it a criminal offense to threaten to do that, which is important to know.
- 16:11Michael Mulligan: Um and so this is a case, it's out of nanaimo.
- 16:15Michael Mulligan: It's a a decision that just came out uh a few weeks ago.
- 16:19Michael Mulligan: Um, and it was a case where uh a person pled guilty uh to doing exactly that.
- 16:25Michael Mulligan: It was uh publishing uh intimate images taken of a former um intimate partner um after threatening to do so and then going through with that uh threat acting on it, um uploading images to uh a website, frankly, I've do this work for quite a while, I'd never heard of it, called FetLife.
- 16:44Michael Mulligan: Uh but uh one of the amusing things I think about it is the uh judge uh describing the various aggravating factors in the case, because the judge was asking to determine what sentence to impose.
- 16:54Michael Mulligan: Uh the judge pointed out here that FET Life is not an obscure website, but easily accessible and well known to members of the public.
- 17:01Michael Mulligan: Anyway, so I thought that was amusing.
- 17:03Michael Mulligan: At least uh there's now some judicial uh determination that that's a well-known uh site.
- 17:08Michael Mulligan: And so these images or videos were actually uploaded to that site, and the the judge was left with having to come to a decision about what the appropriate sentence was.
- 17:19Michael Mulligan: Um and because that section is relatively recent, um neither uh crown or defense were able to find any uh like BC appellate court authority for sort of the range of sentence that could be imposed, and so the judge was left looking at various other uh provinces, what other appellate courts have done there, um, and other trial decisions, uh sentencing decisions in in British Columbia.
- 17:43Michael Mulligan: Uh and uh the uh Crown in this case was seeking a sentence of nine months in prison and followed by a period of probation, and defense was seeking a conditional sentence, which is house arrest.
- 17:55Michael Mulligan: Um, and the sentencing decision was made more complicated for the judge in this case because the accused was uh himself indigenous, and there was a report uh about his background, um, and there were a number of things which uh sadly are not uncommon in these things called GLADU reports that sort of provide background about uh indigenous people for the purpose of sentencing.
- 18:19Michael Mulligan: And in this case, it included an accused person who had the background of being physically abused by his mother and sexually abused by uh a family member when he was a young child.
- 18:30Michael Mulligan: And so that may well have fed into uh the offending behavior here.
- 18:35Michael Mulligan: Uh and a judge is required to take that into account.
- 18:39Michael Mulligan: It's expressly required by the criminal code in Canada when sentencing somebody who's indigenous on the theory that it could result when you have that kind of background in reduction in moral culpability.
- 18:52Michael Mulligan: That's the way that's phrased.
- 18:54Michael Mulligan: Um and so the judge was required to grapple with this serious conduct of uploading these images, which had a real impact, or videos, real impact on uh the uh victim in this case, uh, but weighed up against the fact you're dealing with uh a person who was indigenous that had obviously a very challenging background growing up.
- 19:14Michael Mulligan: For the judge here, the factors uh that ultimately weighed in favor of imposing a six-month jail sentence rather than a uh conditional sentence included the fact that the uh person uh being sentenced had a prior criminal record, including for extortion of a prior intimate partner, um, and I think another conviction of mischief with respect to the same victim that had these uh images uploaded.
- 19:39Michael Mulligan: And so the the judge ultimately uh came to the conclusion that even though uh this fellow might not have been uh a risk to the community if he was on house arrest, and that's one of the key uh criteria for there being a uh house arrest conditional sentence imposed.
- 19:56Michael Mulligan: And so the judge concluded that even though this person may not have been a risk to the community, um if he was at home on a conditional sentence that might, for example, prohibit using or accessing the internet, that just given that background and the seriousness of this, um that simply wouldn't be uh an adequate proportionate sentence for the offending involved.
- 20:17Michael Mulligan: Uh and so what the judge chose to do is to take into account that indigenous background and to reduce the sentence that the Crown was seeking from nine months to six months, uh, and that is the sentence that was imposed, followed by a period of probation, uh, but concluded that uh it would not be appropriate to impose a uh conditional sentence in all of those circumstances, including that uh background.
- 20:40Michael Mulligan: The other thing listeners should be aware of is that in BC there's actually now a process for civil remedies for people to seek financial compensation that's through the Civil Resolution Tribunal.
- 20:50Michael Mulligan: So people may have heard of that uh as a sort of topical thing over the past couple of years, but it's important to know that in addition to that element of it, uh this is now covered under the criminal code and can result in pretty significant uh sentences, both for actually doing it and even in circumstances where there's simply a threat to do it.
- 21:09Michael Mulligan: Um that's the latest from the BC provincial courts in terms of sentencing for uh uh a relatively uh relatively new offense.
- 21:16Adam Stirling: Michael Mulligan with Mulligan Defense Lawyers, legally speaking, during the second half of our second hour every Thursday.
- 21:21Adam Stirling: Thank you so much, Michael.
- 21:22Adam Stirling: Pleasure as always.
- 21:23Adam Stirling: Thanks so much.
- 21:24Adam Stirling: Always great to be here.
- 21:25Adam Stirling: All right.
- 21:25Adam Stirling: Quick break.
- 21:26Adam Stirling: The news is next.