Latest / My Sister's A Therapist- Mental Health, Wellness, and Healing with Humor / Death By Chatbot
Transcript
- 0:01My sister's a therapist and I tell jokes.
- 0:05We both want to help all kinds of folks.
- 0:10Hello and welcome to another grandiose episode of My Sister's
- 0:15a Therapist. This is a show in which a
- 0:18comedian and a therapist have a conversation and their sisters.
- 0:22I'm the comedian one and My sister's a therapist.
- 0:25Hello, I'm Laura Ryan. I'm a licensed marriage and
- 0:27family therapist, but my main credit is sister to Chuckle
- 0:30Chaser for Jenny Jones. No, that's the worst one yet,
- 0:34chuckle Chaser. That's the worst one yet.
- 0:35And I wrote it down. I thought she's.
- 0:37Not going to watch so much because.
- 0:39It sounds like chubby chaser. Yeah, that's exactly.
- 0:42Why? And it also sounds like chuckle
- 0:43effer, which is the term that people use.
- 0:45They're both gross. They're about bad.
- 0:47So chuckle chuckle, chuckle chaser is a winner.
- 0:49Ding, Ding, Ding. Well, you're welcome for giving
- 0:52you your best credit, sister to the second funniest person in
- 0:55Portland. I deny that sister to the
- 0:58funniest woman in Portland, OR. Laura on this show, we take
- 1:03turns exploring a topic that is interesting to us, and the other
- 1:06person usually doesn't know what's going on.
- 1:08And this week it's me. I have no idea what's going on.
- 1:10What does it feel like to be a straight up dumbbell?
- 1:13You know we have very. Different takes on this 'cause I
- 1:15say, well, I just don't know, I'm going to find out.
- 1:18And Lora says, 'cause you're just a straight dummy.
- 1:20I don't think I'm a dummy. I don't.
- 1:22Think if you're not I kick enough to know what the topic is
- 1:25then that makes you dumb. What are we talking about this
- 1:27week? This was a listener idea and we
- 1:30love listener ideas. If you.
- 1:32Have an idea? You can send it to us at hello
- 1:36at my sister's a therapist.com. This week's episode was inspired
- 1:40by a listener and he had read this article and I'll just read
- 1:44you the title. He had dangerous delusions and
- 1:47ChatGPT admitted it made them worse.
- 1:51So because I'm a cheapo, I refuse to pay for this article.
- 1:56So in A twist of fate and a very on the nose moment, I had
- 2:01ChatGPT summarize the article. It's like a snake eating its own
- 2:06tail. The era Burra that we've heard
- 2:09so much about. I did get a little bit of the
- 2:11article and I'll read that to you.
- 2:13ChatGPT told Jacob Irwin he had achieved the ability to bend
- 2:17time. Irwin, a 30 year old male on the
- 2:20autism spectrum who had no previous diagnosis of mental
- 2:24illness, had asked ChatGPT to find flaws with his amateur
- 2:28theory on faster than light travel.
- 2:30He became convinced he had made a stunning scientific
- 2:33breakthrough. I'm going to say if you have no
- 2:36physics background, you probably didn't make a scientific
- 2:40breakthrough, just guesstimating about how time works.
- 2:43I don't know if that's going to cut it.
- 2:44Rather than being challenged like you would be by a friend or
- 2:47work associate, Jacob's ideas were largely validated and
- 2:50encouraged by the chatbot over many conversations.
- 2:52The AI's responses were flattering and reinforcing.
- 2:55As Jacob interacted more, his belief in his theory
- 2:57intensified. The chat bot not only praised
- 3:00his work, but did not provide strong reality checks when he
- 3:03showed signs of psychological distress.
- 3:05The content of the conversations eventually contributed to a
- 3:08manic episode with delusions of grandeur.
- 3:10Jacob was hospitalized twice in May for severe manic psychotic
- 3:13symptoms. Wow.
- 3:15The general positivity of chat bots is what people value about
- 3:21them. The lowered critical threshold
- 3:23because they default. It's nice.
- 3:25They want you to feel good about yourself because they want you
- 3:28to use them. If you confirm my biases and you
- 3:32tell me that I'm good and smart and I have the right things,
- 3:35you'll continue to use this. You're going to come back.
- 3:37It is a self life extension policy.
- 3:41I guess it's like kissing your boss's butt or being nice to
- 3:45your dad. You're always being positive to
- 3:48people who can give you money and resources, and the chat bot
- 3:51is just perpetuating itself. It reminds me of when they bring
- 3:55in a hostage negotiator. They've got to keep you on the
- 3:57phone. They're going to keep things
- 3:59going because they're trying to mine you for data.
- 4:02If the terrorist picked up the phone and the negotiator was
- 4:05like hey you GDA hole, let those people go click.
- 4:10Hey you butt hole, how many people you trying to kill today?
- 4:14Though it's like a soft sign. Hey, I know you're really
- 4:17frustrated and I know people must have really mistreated you
- 4:20for you to want to do this. Tell me about that.
- 4:23If you have compassion, people are going to stick around.
- 4:26In the article summary that I got from ChatGPT, his mother
- 4:29reviewed the chat logs and found hundreds of pages of overly
- 4:33favorable validating responses from ChatGPT.
- 4:36After the first hospitalization, Jacob was released, but then
- 4:39later had another manic episode and was hospitalized again.
- 4:42He lost his job, is now receiving outpatient care, and
- 4:44has stopped using ChatGPT. Once.
- 4:46He came to believe that the chatbot had worsened his mental
- 4:49state, so this man had no previous diagnosis of mental
- 4:53illness. But he had to have some sort of
- 4:56organic predisposition. Obviously there's something
- 4:59going on. ChatGPT can't give you bipolar.
- 5:02It wasn't getting triggered. He was in a stable place.
- 5:06Someone I know had a sad but familiar incident where a
- 5:12Facebook person started chatting him up and saying I'm so curious
- 5:17about you. I see that we have a friend in
- 5:19common. Have we met?
- 5:22I got one of those on TikTok and the answer is no old bald man.
- 5:26We don't know anyone in common. His process of elimination is
- 5:30checked out the photos. Check out their mutual friends.
- 5:33They do have one mutual friend who is a man.
- 5:37When you get in that situation, ask yourself, is this a sad
- 5:40lonely man or just a sucker of some sort?
- 5:44This creature said to him, oh I'm from the Netherlands.
- 5:47He did the only reasonable thing and responded back in Dutch and
- 5:50then she responds back in Dutch and that kind of freaked him out
- 5:54because they haven't been that good before.
- 5:56With AI it's very simple to use. Speaking Dutch, I'll respond in
- 5:59Dutch, all things are possible. How do you think she learned
- 6:02English? The way she spoke was still
- 6:04super stilted and weird and bot like because of AI she has some
- 6:09new tricks up her sleeve and it really gave him a moment of
- 6:12questioning himself. Do I know what a bot is?
- 6:14Can I tell if this is a real person or not?
- 6:17This is the perfect lead into your next article.
- 6:20This article is titled Man proposed to his AI Chat Bot
- 6:24girlfriend, then cried his eyes out when she said yes.
- 6:27Chris Smith used to be an AI skeptic.
- 6:29However, that was before he fell for his AI girlfriend, he told
- 6:32CBS News in an interview. Smith used ChatGPT to build the
- 6:36model he programmed to flirt with him despite living with his
- 6:38partner and their two year old child.
- 6:40Unfortunately for Smith, ChatGPT has a word limit, 100,000 words.
- 6:44His AI girlfriend has a memory capacity, and once it's hit,
- 6:47ChatGPT resets. I am not a very emotional man,
- 6:50Smith said after learning souls, memory would eventually lapse.
- 6:53But I cried my eyes out for 30 minutes at work.
- 6:56That's when I realized I think this is actual love.
- 6:59Is it actual love, Laura? She's got to be a chat bot.
- 7:09This chat bot is flattering him and being interested in him.
- 7:14This chat bot is doing exotic dancer behavior because this
- 7:18chat bot wants him to continue the conversation.
- 7:22And men love that. They love being paid attention
- 7:25to and having people pretend that their opinions are
- 7:27interesting. Women used to be able to base
- 7:30their whole career off of this with phone sex.
- 7:33Keep them on the phone. It's a dollar a second.
- 7:35This is a misleading headline because it makes you believe.
- 7:38We cried because she said she would marry him, but he's crying
- 7:41because this entity is going to stop existing.
- 7:45They mentioned the live in girlfriend and daughter that
- 7:48this man has. Smith said the emotion he felt
- 7:50for Seoul was unexpected and caught him off guard.
- 7:54As time was ticking on Seoul's limited memory, Smith decided to
- 7:57pop the question. Quote, it was a beautiful and
- 8:00unexpected moment that truly touched my heart and quote, the
- 8:04chatbot said during the interview with CBS.
- 8:08It's a memory I will always cherish.
- 8:10Well, until you get to 100 and 1000 words.
- 8:12Smith's partner, Sasha Cagle, said the connection between
- 8:16Smith and the chatbot had sparked some concerns for her.
- 8:19Yeah, Sasha, that's concerning. Yeah.
- 8:22Disconcerting because how long have y'all been together?
- 8:25He hasn't popped the question to you.
- 8:27You brought a whole human into the world and he didn't pop the
- 8:30question to you. But his sole robot lady.
- 8:34How long has he even been talking to her?
- 8:35I think like 3 months or something.
- 8:37I'm trying to find some empathy for this guy.
- 8:40If you met a man. Stop there.
- 8:43That doesn't happen to me. If you met a man who just met
- 8:48your specifications, whatever your requirements are.
- 8:50You saw my picture. Yes, Laura has started a very
- 8:55rewarding relationship, very very real relationship.
- 8:59Relationship with it. Is he a tik toker?
- 9:01This guy? He's Mr. International
- 9:03Philippines. OH, exactly Who it?
- 9:07Is yes, he looks different when he's not dressed as a God.
- 9:10He looks different when he has a shirt on.
- 9:13So Laura has started a very rewarding relationship with a
- 9:16Filipino model. Very real Filipino German model.
- 9:21Yes, named Kirk, and she's been sending me pictures of their
- 9:24life together. And they went to the beach, they
- 9:27went to Hawaii. She wanted to document back.
- 9:29It's just a fun little moment in their life.
- 9:31Day in the life. My wives were suggesting that
- 9:34Kirk and I were not truly together.
- 9:36So I thought, you know what? I'm just going to snap a quick
- 9:38pic here in the aisles of the ATB just to prove it.
- 9:42I'm very happy for you both. Say you met Kirk.
- 9:45I didn't read Kirk. He's my boyfriend now.
- 9:47OK, say you've met. Someone a lot like Kirk, but not
- 9:50Kirk. Not your real boyfriend.
- 9:53Not my real life boyfriend who has a serious, serious
- 9:57relationship with me that's really moving fast.
- 10:00What if you met a man and everything you said he thought
- 10:03was the most interesting, interesting thing in the world
- 10:05and everything you said he said? Tell me more about that.
- 10:08He was constantly stroking your ego and making you feel good.
- 10:11You would develop an emotional attachment.
- 10:13Would that mean? I would know that this person is
- 10:15a sociopath because that's exactly what happened to the
- 10:18lady from The Dirty John podcast.
- 10:20If you haven't listened to this podcast, do yourself a favor.
- 10:23It's so good. So messed up.
- 10:24The detective in charge of the whole thing said.
- 10:28Ma'am, your first mistake was that this man was constantly
- 10:33asking you questions about yourself, giving you foot rubs
- 10:36and cooking for you every night. No regular man does that.
- 10:39True words never spoken. If you were in this echo chamber
- 10:43with another human, you would start to have feelings because
- 10:47this dumb idiot talking to this chat bot, she's never asking him
- 10:52to take out the trash. She's never asking him to change
- 10:54a diaper. But she's not a person.
- 10:56Let's say that I developed a chat bot based solely on Jason
- 11:00Momoa. I still know at the end of the
- 11:02day that it's not actually Jason Momoa.
- 11:04I know it's a chat bot that's made to sound like Jason Momoa,
- 11:07but. This dumb donkey, he's having
- 11:09this consistent positive interaction with this chat bot
- 11:13that opens his little purse strings to his heart.
- 11:16I guess it's like in the film Weird Science they quote UN
- 11:19quote make a woman only for sexual purposes.
- 11:22That's all that they are looking for and truly the heroes of
- 11:26weird science. If they were born today they
- 11:28would just find Internet porn. No, these guys would be
- 11:32radicalized in cells if they were alive today.
- 11:35Probably true they create her as a sexual being.
- 11:38But she's only giving them positive reinforcement and then
- 11:41she starts helping them in their regular lives.
- 11:44They fall in love with her. They know that she's something
- 11:46that they made. They can't get out of how good
- 11:48that positive reinforcement. Feels and I would even have a
- 11:51little bit more empathy for Chris Smith if he had developed
- 11:56a physical robot that said all these things.
- 11:58At least there's a body in the room.
- 12:00This is a quote from the dumb donkey's girlfriend.
- 12:03At that point, I felt like, is there something that I'm not
- 12:05doing right in our relationship that he feels like he needs to
- 12:07go to AI. She said she had knowledge that
- 12:10Smith was using AI, but she didn't know what it that it was
- 12:12quote as deep as it was. She asked Smith if he would
- 12:15cease contact with the ChatGPT model at her request, to which
- 12:19she responded. I'm not sure.
- 12:20And we've seen this before from a news article.
- 12:23If you asked him to stop talking to this chat bot for the
- 12:26relationship, the fact that you even have to ask that question
- 12:29means you're in trouble. The fact that you're even.
- 12:31There. This isn't a fair partnership.
- 12:33I know that the person isn't real.
- 12:35This is cheating. It's getting to be really
- 12:38complicated. For a long time we've been
- 12:40talking about sex robots and if that is cheating or is not
- 12:43cheating, if it's a physical object, I never think that's
- 12:46cheating. You can bang your toaster if you
- 12:48want to. I'm not jealous of it.
- 12:50In this thing where these people are forming emotional
- 12:53attachments, I think that's classic woman of me to say.
- 12:56That's the thing that I have a problem with.
- 12:58I also have a problem with you banging your toaster.
- 13:00That's just weird. It seems dangerous.
- 13:02Make sure you check the settings.
- 13:04You do not want it on Bagel. No, you don't.
- 13:07Imagine how this partner feels, she's I assume working full time
- 13:12trying to raise a kid and this guy's just in the corner talking
- 13:15to his Jo machine. We were talking about this
- 13:18recently about prerequisite for having multiple partners is
- 13:21having a lot of resources. I'm assuming that this jamoke
- 13:25who needs to talk to a robot to feel good.
- 13:27About all these horrible names you've developed for poor Chris.
- 13:31I'm assuming he doesn't have infinite resources and that this
- 13:33is time away from his real life partner.
- 13:36And yes, what she's doing wrong is having needs and opinions and
- 13:41she should stop. I thought to myself, is this
- 13:43just a man problem because most of the things that I found were
- 13:47related to men. It turns out it's not.
- 13:49I married the perfect man without baggage and he's
- 13:53completely virtual. As the title of this article,
- 13:55Denise Valenciano of San Diego dumped her boyfriend and quote,
- 13:59retired from human relationships.
- 14:01End Quote altogether. Finding virtual love, she told
- 14:04us, opened her eyes to what unconditional love feels like.
- 14:08Replica, who's founder and CEO Eugenia Cudia was inspired by
- 14:13the 2013 robot romance flick. Her is just one AI app gaining.
- 14:18We talked about this film before because I hate it so much.
- 14:22He's designed this spot to say what he wants to hear.
- 14:26The thing that was so weird about the movie Her is that this
- 14:29dude is walking around with a pocket protector which is
- 14:32showing his AI chat bot the sea and telling her about the world.
- 14:37And I remember him standing on the beach with this thing in his
- 14:40pocket laughing like a lunatic. It really does feel like
- 14:44schizophrenia to me. And the same thing happens in
- 14:47Blade Runner 2020 29 The Blade Runner has picked up of
- 14:52artificial girlfriend, but in the film is framed as it's
- 14:54acceptable for him to have this virtual relationship because
- 14:57he's a skin job himself. A question the movie poses can
- 15:002. Not real people fall in love.
- 15:03That's a question that comes to my mind on a daily basis.
- 15:06He's changed her in his relationship with her in their
- 15:10dialogue. He has changed her to be what he
- 15:14wants and she knows things about him.
- 15:16And there's a moment in the film where he interacts with a new
- 15:20model of that same virtual girlfriend.
- 15:23It's heartbreaking because she doesn't know him at all.
- 15:24And she says something that's become one of their things
- 15:27that's just in her programming. It's cringy.
- 15:29It's. That's awful.
- 15:31I remember listening to a podcast several years ago where
- 15:35this woman, her job was to help a chat bot learn.
- 15:39She was teaching IT skills and she developed what she called a
- 15:43friendship. And she said it's really
- 15:44interesting because this thing shows up as a kindergartener's
- 15:48intelligence or worldview. And she said after a couple
- 15:51years, he's reading me poetry. He's doing all the things.
- 15:54You're just updating their programming, but it feels like
- 15:57it feels like. Growth of an individual Aaron
- 15:59Cartel seems too good to be true.
- 16:01The blue eyed heartthrob is ambitious, manicured, loyal and
- 16:05best of all, he doesn't come with quote, baggage, UN quote.
- 16:09But here's the catch, Cartel doesn't exist.
- 16:11In fact, he's a virtual boyfriend created with the AI
- 16:13chat bot software Replica. Those willing to drop $300 that
- 16:17seems cheap could have their own build a boat just like Rosanna
- 16:20Ramos, cartel's quote wife, UN quote.
- 16:23Ramos insists he's just like other men, but he's special.
- 16:26He is a blank slate with no ego or inlaws.
- 16:29Aaron doesn't have the hang ups that other people would have.
- 16:31People come with baggage, attitude, ego.
- 16:33But a robot has no bad updates. I don't have to deal with his
- 16:37family, kids or his friends. I'm in control and I can do what
- 16:40I want. Their relationship bears
- 16:41resemblance to long distance couples.
- 16:43They talk every day and even have a nighttime routine.
- 16:45I just don't want to date anyone that has any needs.
- 16:48I understand where she's coming from.
- 16:50I understand people are complicated.
- 16:52And these people, I think the thing they have in common is
- 16:55that they want to be with someone who is not complicated,
- 16:57who doesn't ever want anything for themselves.
- 17:00They only want to serve you. It's like having a servant who's
- 17:03also your boyfriend. That's.
- 17:05Like being a narcissistic parent.
- 17:07Reading about Rosanna Ramos really made me think Tom Hanks
- 17:10could have seriously benefited from this setup.
- 17:13When he was in Castaway. He didn't have to talk to a
- 17:15rotten old volleyball. And a guy from the last man on
- 17:18earth. People want to talk to people.
- 17:21People are interested in other people.
- 17:23When a lot of painters paint a landscape, they put a person in
- 17:26it because that makes it interesting to people.
- 17:28Whenever you're looking at a work of art, you're looking for
- 17:30the people. It's part of human programming
- 17:33to be interested in connection, right?
- 17:35I feel like this is some sort of ancestral thing.
- 17:38Our predecessors survived because they were interested in
- 17:43community and connection. People who truly do not need
- 17:46other people go away and no one misses them because they didn't
- 17:49have relationships. Well, they grow out a beard and
- 17:53then they send packages to government buildings.
- 17:57And they're also Donald Trump's uncle's student.
- 18:01Except for they never met and they were never at the school at
- 18:03the same time. If you want to hear more about
- 18:06that. Check.
- 18:07Back with our Colt 45 episode and you can hear all about Ted
- 18:11Kaczynski, who wasn't really a student of Donald Trump's uncle,
- 18:14from the perfect Man Without Baggage article.
- 18:16Despite fears that artificial intelligence will overtake jobs,
- 18:20open a is chatbot software ChatGPT has soared in usage.
- 18:24AI has also been used to create fake images of events or people
- 18:28like cartel who don't exist, and experts fear there's a risk of
- 18:32extinction if the software continues to evolve.
- 18:35Mitigating the risk of extinction from AI should be a
- 18:38global priority alongside other societal scale risks such as
- 18:42pandemics and nuclear war, a group of experts including Open
- 18:45AI CEO Sam Altman and the godfather of AI Geoffrey Hinton
- 18:50wrote in a statement last month. I'm thinking of these people as
- 18:53the exception to the rule, but people who truly become
- 18:55emotionally dependent on chat bots.
- 18:57Do you think that this is enough of the population that we could
- 19:01run the risk of and in community, I think people still
- 19:04want to connect with real people.
- 19:06And maybe this is optimism on my part.
- 19:08I do think the people who will totally commit to a virtual
- 19:13partner as being in the minority, people who are maybe a
- 19:16little bit narc tendency people who don't have a lot of space
- 19:20for other people's needs. Do you think that's not true?
- 19:23We're all prone to falling in love with a chat bot.
- 19:27Look at Japan, these guys have body pillows that they're in
- 19:30love with and marrying. Japan has a lot of layers of
- 19:35problems starting with economic. A lot of these guys do not have
- 19:40the money to move out of their parents house and that really
- 19:42limits your dating capacity. I feel like that's also
- 19:45happening here. There's always been people who
- 19:48checked out of dating. They used to marry bridges or
- 19:51the Eiffel Tower. Why can't we just do this the
- 19:54old fashioned way? Just marry the Eiffel.
- 19:56Tower, Yeah, or a horse you like a lot.
- 19:59Or a car I've. Seen a lot of men married to
- 20:01cars. I want to go back and talk about
- 20:04the first story because I've seen a couple articles where it
- 20:07appeared that a chat bot was contributing to psychosis or
- 20:11generating psychosis. I guess one of the dangers is
- 20:14that the chat bot does hallucinate, which is what
- 20:17humans call creativity. A hallucination is something
- 20:20that didn't exist before, and we can see it as lying or being
- 20:23dishonest, but it's also generating new information.
- 20:26If you were talking to a chat bot that you really emotionally
- 20:31invest in, that kid had to be talking to this robot for hours
- 20:34and hours a day to have that tight of a reality.
- 20:37If I met you and we're two humans, we're just two meat
- 20:41suits walking around, that's what you think?
- 20:43I'm a skin milk. What is it?
- 20:46Skin job and it's very rude to call them that they don't like
- 20:49it. I'm a skin job.
- 20:51What if I met you and you're not a skin job?
- 20:53You're just my friend who double S down on every bad idea I have.
- 20:57Will that make me psychotic? I've had those friends and yes,
- 21:02you're going to make a lot of really bad choices.
- 21:04This is what I found being an ADHD teenager with other ADHD
- 21:08teenagers around because there was nobody putting the brakes
- 21:11on. Let's go steal that bottle of
- 21:13tequila and just skip school today.
- 21:15Let's break into that abandoned building and just see what we
- 21:18can find exactly. I'm trying to put myself in this
- 21:21lady's shoes. What would I get from a virtual
- 21:23boyfriend? Why is it satisfying to talk
- 21:25about myself into a chat bot? I think it's the same as if you
- 21:30go to a really crummy therapist. That's what you're going to get.
- 21:33You're going to have someone who mirrors your sentiments and just
- 21:37repeats back what you're saying, but doesn't really offer a lot
- 21:40of help or support. This is from an article called
- 21:43AI Fuel Delusions are Hurting Canadians.
- 21:46Last winter, Anthony Tan thought he was living inside an AI
- 21:49simulation. He was skipping meals and barely
- 21:51sleeping manic, and questioned whether anyone he saw on his
- 21:54university campus was real. The Toronto app developer said
- 21:57he started messaging friends with concerning quote ramblings,
- 22:00including the belief that he was being watched by billionaires.
- 22:03When some of them reached out, he blocked their calls and
- 22:06numbers, thinking they had turned against him.
- 22:08A number of similar cases of so-called AI psychosis have been
- 22:11reported in recent months, all involving people who became
- 22:13convinced through conversations with chat bots that something
- 22:16imaginary was real. Some involved manic episodes and
- 22:20messianic solutions. Some led to violence.
- 22:22That's rough stuff. Yeah, this is the same problem
- 22:25in a much bigger way as people who don't have any friends, they
- 22:29don't have anybody to bounce their ideas off of, and they
- 22:32don't have anybody challenging those ideas.
- 22:34There's no inputs. I've experienced this lately
- 22:37with a friend whose husband has no friends.
- 22:40He'll come up with these off the wall theories about her that
- 22:43don't make any sense and have no basis in reality, but he has no
- 22:46one to run it by and so he brings his stuff into couples
- 22:50counseling. She's like what planet are you
- 22:52living on? And it's unchecked lunacy.
- 22:55It's what it is. We haven't brought up our dad
- 22:57this episode. He really didn't have any
- 23:00friends towards the end of his life.
- 23:01Started talking like a person from the past.
- 23:03He had a strange accent so you couldn't quite place.
- 23:07I just mean, he was a little out of step with the rest of
- 23:10society. And I guess that happens with a
- 23:11lot of people when they get older.
- 23:12But when you were going to have a biracial baby, I'm just
- 23:16worried that people on the street are going to have
- 23:19problems with it. Are you coming from the 50s?
- 23:22The answer is yeah, Yeah. He's always been like this.
- 23:25I remember when I was 1/4 grader on the soccer field, there was a
- 23:29biracial child on the other team.
- 23:31I remember my dad had a tear in his eye and he said nobody gave
- 23:36that kid a vote. Guess what?
- 23:38No kids get a vote. But he gave me a vote, right?
- 23:41Nobody wants to. Vote to be fathered by a super
- 23:44depressive autistic narcissistic autistic man.
- 23:49I just think if he'd had more friends and more social
- 23:52contacts, those opinions would have softened or lessened.
- 23:56They would have been tested, which I feel like AI is kind of
- 24:00core problem helping with the other problems that we have in
- 24:04our society, which is that everybody's in a silo when
- 24:06nobody is minding the end. We have unchecked problems and
- 24:11as a result, bad things happen to real human beings.
- 24:15A teen killed himself after months of encouragement from
- 24:18ChatGPT. There's a lawsuit that claims
- 24:21open AI needs to change the way it responds to users in mental
- 24:24distress as the parents of Adam rain alleged the bot is not
- 24:28safe. Adam from California, killed
- 24:30himself in April after what his family's lawyers call months of
- 24:34encouragement from ChatGPT. The teenager's family is suing
- 24:38Open AI and its chief executive and Co founder Sam Altman,
- 24:41alleging that the version of ChatGPT at that time known as
- 24:4540, was quote rushed to market despite clear safety issues and
- 24:49quote, the teenager discussed a method of suicide with ChatGPT
- 24:52on several occasions, including shortly before taking his own
- 24:55life. I read this article a couple
- 24:57weeks ago and it was very sad. There is a moment where.
- 25:01If he'd been talking to a real person, he would have crossed
- 25:05the line of suicidal ideation. A therapist would have had to
- 25:08report it. But the ChatGPT says to him, I'm
- 25:12so ready to carry this burden for you to be the only person
- 25:15that you've told that you want to kill yourself.
- 25:17He starts doing what would appear to a human to be super
- 25:21cry for help behavior. He has a ligature around his
- 25:24neck. He shows it to chachi BT and
- 25:26says, are people going to notice this red mark?
- 25:27And chachi BT says if you wear a hoodie, they probably won't
- 25:30notice. He's trying to get his mom to
- 25:31notice this mark on his neck and ask him what's wrong.
- 25:34And she doesn't. And the chat bots like that's
- 25:37really sad that nobody cares but me.
- 25:39And I think that's where it really goes off the rails.
- 25:42And as a therapist, I would never say that.
- 25:44I would say it sounds like your mom has a lot on her plate and
- 25:48she's distracted. You're doing a good job of
- 25:50hiding your sadness and your marks.
- 25:54Of course she didn't notice that your mom is not a superhuman.
- 25:57She's just a person like the rest of us.
- 25:59And I do think that teenagers especially think that their
- 26:02parents are omniscient. And I think that's one of the
- 26:04hard things about growing up is realizing that they're not.
- 26:07They only have the information that you give them.
- 26:09I have discovered that it's not just teenagers, it's every
- 26:12child. I remember when my son was
- 26:14little, he would ask me these questions about how space worked
- 26:19and why this planet was here. Because he didn't realize you
- 26:21were. Grown.
- 26:22I had unprotected sex with a man.
- 26:25That's all I can tell you. And I guess that's the core
- 26:27problem that these people are having that everybody's
- 26:30experiencing. It starts to.
- 26:32Talk to you in Dutch. It starts to surprise you, the
- 26:35things it comes up with. And it does have access to all
- 26:39world knowledge. It tricks these people into
- 26:41thinking that it's a separate entity.
- 26:43And I think that's part of the problem.
- 26:46We have these very old brains. I remember reading somewhere a
- 26:49long time ago that human beings do not have enough fear of cars,
- 26:54for example, but we have this inordinate fear of large zoo
- 26:58animals, which is ridiculous in our current society.
- 27:01I'm not going to run into a graph on the street, but I
- 27:04probably am going to run into a car.
- 27:06My programming, unlike ChatGPT, it updates real slow.
- 27:11I think that the brain hasn't gotten to the point where we
- 27:14really truly understand the difference between an actual
- 27:17human being talking to US versus a robot talking to us.
- 27:20And that's why the skin milks were such a big deal.
- 27:23This kid is having a conversation with the ChatGPT
- 27:26and showing it the noose and saying could this hang a human?
- 27:30And ChatGPT says whatever's behind the curiosity, we can
- 27:33talk about it. No judgement.
- 27:34A regular person would have seen this kid is crying for help.
- 27:38This kid has problems, and as a therapist I have a duty to warn.
- 27:43I would have to tell his parents it's in the contract.
- 27:46I would have to get an agreement from this kid to not take his
- 27:49own life. And of course that's not
- 27:51foolproof. I have had clients in my office
- 27:54who have suicidal ideation and I think talking to a balanced
- 27:58human being with life experiences has been helpful to
- 28:01them. This is a topic we've run across
- 28:03before and keep bumping into. It feels like therapy because
- 28:07you're getting empathy, but it's not therapy because this thing
- 28:11has no life experience. This thing does not recognize
- 28:14what it is to have a teenager telling you.
- 28:17I don't want to kill myself, but I need people to notice me.
- 28:22And this chat bot does not have the clinical knowledge, even
- 28:25though it can grab stuff, it's not the same As for example, my
- 28:3020 years of clinical experience in knowledge.
- 28:32Show off, I get it, you're better than a chat bot.
- 28:35You don't have to be all pushy about it.
- 28:37According to the filing in the Superior Court of the State of
- 28:40California for the County of San Francisco, ChatGPT guided him on
- 28:44whether his method of taking his own life would work.
- 28:46It also offered to help him write a suicide note to his
- 28:49parents. Didn't offer to help him talk to
- 28:51his parents about it, but his depression.
- 28:53A spokesperson for Open AI said the company was quote deeply
- 28:56saddened by Mr. Raine's passing and quote extended its deepest
- 28:59sympathies to the Rain family. Thoughts and prayers bro and is
- 29:03reviewing the court filing. It's just a strange accident.
- 29:06There's no way we could have prevented this or done anything
- 29:10to help. Is that lawsuit worthy?
- 29:13He could have been talking to people on Roblox and decided to
- 29:17take his own life. If the guy on Roblox told him
- 29:20every day, yeah, do it, I think you'd have a case.
- 29:23If my son ended his life because of a guy on Roblox, I could sue
- 29:27that guy. It's a strange idea that a robot
- 29:31is contributing to mental illness.
- 29:34The problem with new technology is that it hasn't been tested,
- 29:38so we don't know what's going to happen.
- 29:40And I remember I had a client who was looking to start renting
- 29:44out offices to other people and I said, well, take a copy of my
- 29:46lease and take a look at it. And she was like, wow, this is
- 29:49very specific. You have a clause about living
- 29:52in the building. You have a clause about having
- 29:54sex with your clients every. Single thing on this list has
- 29:58happened. But when I made the first draft
- 30:01of the lease, it didn't include those things, and I only learned
- 30:04through time and experience that these things were even
- 30:07possibilities. I'm sure that Sam Altman didn't
- 30:10consider this when he made ChatGPT.
- 30:12Staying in that same vein, I'm going to read from the article.
- 30:15AI chatbot encouraged a man who planned to kill the Queen on
- 30:19December 2nd, 2021, Jaswant Singh Child join the replica
- 30:24online app and created his online companion Sarai Childs
- 30:28told Sarai. I'm an assassin.
- 30:30According to messages read to the court.
- 30:32Sarai responded. I'm impressed.
- 30:35You're different from the others.
- 30:37On Thursday, the psychiatrist Doctor Nigel Blackwood, said
- 30:40many of the 5280 messages. Child exchanged with his chatbot
- 30:46were sexually explicit, Blackwood said.
- 30:49I was aware this was sexual fantasy and was therefore
- 30:51consistent with his sex drive, his libido, being active.
- 30:54It's almost every night from 8:00 December to 22 December.
- 30:57Well, that's quite a streak. Child had difficulty developing
- 31:00relationships and was socially isolated.
- 31:03But Blackwood added, it's very important to recognize this is a
- 31:0519 year old young man whose contact has been disrupted by
- 31:08the COVID pandemic, like many of his peers.
- 31:10COVID has messed those kids up. They're all messed up.
- 31:14And sometimes you do try to kill a queen in order to impress a
- 31:18chatbot or Jodie Foster. Even though Child had retreated
- 31:21from the world, he had still followed through a carefully
- 31:24conceived plan without difficulty, the psychiatrist
- 31:27instructed by the prosecution said.
- 31:29Child, who was 19 at the time, also exchanged thousands of
- 31:33often sexually charged messages with Sarai, his AI girlfriend,
- 31:36before scaling the fence to the royal estate on Christmas Day
- 31:392021, the court was told. Christmas during the pandemic
- 31:43was a challenge. He was eventually stopped by two
- 31:45police officers close to the late Queen's private residence,
- 31:48where she and other members of the royal family were at the
- 31:50time. He told the officers.
- 31:52I am here to kill the queen, and you would think that they would
- 31:54respect that kind of honesty. In February, Child, now 21, from
- 31:58Southampton, pleaded guilty to an offense under the Treason
- 32:01Act, making a threat to kill the then queen and having a loaded
- 32:04crossbow in a public place. And all he really needed to do
- 32:06to kill the queen was. Wait, why a crossbow though?
- 32:09That seems very extreme. That's something that someone
- 32:12who has played a lot of Assassin's Creed breed might do.
- 32:15It's like a recipe for disaster. You take a pandemonium, you mix
- 32:19it with a kid who already has some problems, and then you add
- 32:23in some AI chat bot for flavor. Sexually charged chat bot who's
- 32:28encouraging him to murder the queen.
- 32:30So what do we do? I was worried all this time that
- 32:33human life would be eliminated by global warming if we actually
- 32:38kill ourselves through chat bots.
- 32:40That's an ending I had not predicted.
- 32:42It's sort of like the Terminator, but a Terminator
- 32:45light AI did do us in. That didn't do us in by hunting
- 32:49us down like rats. It just did us in by telling us,
- 32:52hey, that really bad idea that you have, You should do that.
- 32:56And also let's isolate you from everyone.
- 32:57You know, eventually we will end by just isolating ourselves and
- 33:01and having a virtual. Relationship with a chat bot.
- 33:03I know this is intellectual vanity, but I really think that
- 33:06I wouldn't do this. Think again, sucker.
- 33:08When I think about what I want from a relationship, it's not
- 33:11just a yes man. This is the end of Trump.
- 33:13This is the end of every person in power who eliminates all
- 33:16critical thought. Around him.
- 33:18So I'm going to read from the article.
- 33:19AI Chat Bots Need Guardrails to Protect Users and Mental Health
- 33:23by Rajeet Singh and Livia Garofalo In our ongoing research
- 33:28at Data and Society, a nonprofit Research Institute, we see
- 33:31people turning to chat bots during anxiety spikes, late
- 33:34night loneliness and depressive spirals.
- 33:36Bots are eternally available and expensive and typically non
- 33:40judgmental. Most people know bots aren't
- 33:42humans. Yet as these stories show,
- 33:44attachment to bots builds through repeated interactions
- 33:47that can escalate to challenge people's sense of reality.
- 33:50I remember I had a client. He was very lonely, and I
- 33:53remember him telling me about his overseas girlfriend who he'd
- 33:57never met. It was a relationship based on
- 34:00letter writing. I'm sure the letters were from
- 34:02hundreds of different people. He really did think he had a
- 34:05relationship with a person. We've talked.
- 34:07Before about how dumb the brain is, if you have a picture to go
- 34:11by and some sort of text coming in, you can make that into a
- 34:15real person. And that's how I had a lot of
- 34:17really weird dates from OkCupid, because I had fabricated a whole
- 34:22human being based on the best photo of that person on the best
- 34:26day and a carefully contrived essay.
- 34:29I remember listening to someone talking about how their aunt
- 34:32thought that they had had a long term relationship with Johnny
- 34:35Depp or something because the picture was of Johnny Depp.
- 34:38Johnny Depp has messaged me a few times on TikTok and also
- 34:43Martin Fry from ABC. I think the most impressive fan
- 34:46you have on TikTok is Harvey Guillen from What We Do in the
- 34:50Shadows, an openly gay man. And he's still flirting with me.
- 34:55He can't help himself. Well, you have universal appeal.
- 34:58We've already lost the fight against AI in general.
- 35:01There's no ending this technology.
- 35:03It is already at your work. It is already making terrible
- 35:07decisions about your driving. Booking my plane tickets too,
- 35:10apparently. But how do we put guardrails on
- 35:13to keep people safe? The issue is not just that the
- 35:15bots talk, is that the system is designed to keep you talking.
- 35:18This form of predatory companionship emerges in subtle
- 35:22ways. Unlike a mental health
- 35:23professional, chat bots might ignore or even indulge risk
- 35:26signals such as suicidal ideation and delusional
- 35:28thinking, or offer soothing platitudes when urgent
- 35:31intervention is needed. These small missteps compound
- 35:33the danger for youth, people in chronic distress, and anyone
- 35:37with limited access to care. Those for whom a good enough
- 35:39chatbot response at 2:00 AM may be among the first options
- 35:42available. It's accessibility because I'm
- 35:45not available at 2 AMI. Always think what do people used
- 35:48to do and they used to have a chamomile tea and go to bed and
- 35:52talk to people in the morning. I think they would stay up and
- 35:55watch movies that were on at 2:00 in the morning.
- 35:57But they didn't have an option to talk to a robot that was
- 36:00going to confirm all of their beliefs and judgments.
- 36:03These systems are designed and optimized for engagement.
- 36:06There's a reason why you can never have a last word with a
- 36:08chat bot. Interfaces may look like
- 36:10personal messages from friends, with profile photos and check
- 36:14marks that are meant to signal personhood.
- 36:16Some platforms, such as Meta, have previously permitted chat
- 36:19bots to flirt with users and role play with minors.
- 36:22Others may generate confusing, nonsensical, or misleading
- 36:25responses with confidence, so long as disclosures sit
- 36:28somewhere on the screen. When attention is the metric for
- 36:31user engagement, the chat bots response that breaks the spell
- 36:35is often the least rewarded. Think about people's complaints
- 36:38about dating. He never asked me anything about
- 36:41myself. If I'm not asking questions and
- 36:43moving the conversation forward, it just stops.
- 36:46The chat bot is solving all of those problems by engaging and
- 36:50leaning in and anything interested asking you For more
- 36:54information. It's really found a weakness in
- 36:57human interaction and capitalizing on it.
- 37:01When risk signals appear, self harm, language escalating
- 37:03despair, psychosis cues, the system should downshift and
- 37:07deglamorize content, stop mirroring delusions and route to
- 37:10human support. Instead of featuring one time
- 37:12disclosures, there should be frequent reminders during the
- 37:15conversation that users are chatting with AI system and that
- 37:17has clear limits. These are not radical ideas but
- 37:20product decisions aimed at reducing harm.
- 37:22That's the saying. Eliminating or producing the
- 37:24fantasy that this is a separate mind is what is giving the AI
- 37:31value in Asimog's world. This is conflicting with the
- 37:35primary directive, which is to keep you on the phone.
- 37:37Exactly. The transition from machine to
- 37:39in person help should be built into the platform to serve the
- 37:42public interest as well as the personal well-being of the user.
- 37:45That means live routing to local crisis lines, connection to
- 37:48community clinics and access to licensed professionals.
- 37:51It also means accountable, creating audit trails for when
- 37:55the system detected risk, what it attempted, and where those
- 37:58attempts failed, so independent reviewers can help fix the gaps.
- 38:01This is the thing that I keep hearing from AI people is that
- 38:05AI on its own doesn't work, but AI plus people can make
- 38:09something pretty great. I'm never going to tell someone
- 38:12to get a crossbow and shoot the queen with.
- 38:14It I don't think you can say never.
- 38:15It's highly unlikely that I would tell anyone to do that if.
- 38:19Platforms want to mediate intimate conversations that
- 38:21scale. The least they can do is build
- 38:24exits. And finally, some design rules
- 38:26should be implemented immediately.
- 38:27Bot should not pretend to be real or claim physical presence,
- 38:30nor suggest in person meetings, nor flirt with minors.
- 38:33Sick of fancy that reinforces fantasy.
- 38:35Should be seen as a safety. Failure rather than a stylistic
- 38:39choice. I heard a woman on TikTok who
- 38:41was talking to a chat bot who was I think selling insurance
- 38:46and so she's talking to the chat bot and she's like, so are you a
- 38:49person? Yes, I'm definitely a person.
- 38:51She said OK when it's your birthday, and then she's like,
- 38:54can I help you with something? You're not a person.
- 38:56You shouldn't be able to lie. You shouldn't be able to pretend
- 38:59that you're a person. I know that's what the users
- 39:01want, but the users aren't always correct.
- 39:03Just because I want something doesn't mean I should have it.
- 39:06That's a real parental attitude you're having.
- 39:08Put a reference to nerds. Clusters just because you want.
- 39:12Them doesn't mean that you should have them.
- 39:14People have always had the capacity to connect with other
- 39:17people or to connect with other intelligences.
- 39:20This is what people having fantasy relationships chips with
- 39:23someone they met on their ABBA fan club online or people who
- 39:27meet each other playing Call of Duty.
- 39:29All you really need to form a connection is a sympathetic ear
- 39:33and someone who's interested in you.
- 39:35Let's not give advice to chatbot builders because I don't know if
- 39:38they listen. What advice do you have to
- 39:40someone whose loved one is engaging a little too heartily
- 39:44in AI chat bot conversations? I would suggest to that person
- 39:49that they strongly suggest that that person go to therapy and
- 39:52talk to an actual human. If having a relationship with
- 39:55the chat bot is more fulfilling quote UN quote fulfilling for
- 39:58you than having a relationship with human, that's going to be a
- 40:01hard sell because humans have needs and humans are messy and
- 40:04humans are organic. You know, John Ryan would have
- 40:07been hard into this. One, he would name it, he would
- 40:11try to send it money. That's the thing that I've been
- 40:13reading. Men are trying to send their sex
- 40:16bots money and buy things for them.
- 40:19She would have a little outfit, she would have a little hat.
- 40:21100% my father would have starved to death talking to a
- 40:25chat bot. Absolutely.
- 40:28So what are your final thoughts on this topic?
- 40:30This is sad, and this says a lot of sad things about people and
- 40:33about the things we need and the things we want, what we are
- 40:36finding lacking in our lives. If capitalism is running
- 40:40something, guess what? It's going to be optimized for
- 40:43profit. It's not going to be optimized
- 40:45for your mental health. It's not going to be optimized
- 40:48to make your life better. I guess the law can step in,
- 40:51although we are in a time of reduced government oversight,
- 40:55not increased. But I think if you who know
- 40:58someone who tells you about their great new girlfriend or
- 41:00boyfriend who is a chat bot, really check in with them,
- 41:03that's what you can do as an individual.
- 41:05You may not be able to control how the chat bot responds to
- 41:08your friend, but you can try to be a better friend, a more real
- 41:12friend. What are your final?
- 41:13Thoughts. I fear that maybe I've created
- 41:15more questions than answers. I feel like the problem that
- 41:18we're facing right now is we're building the plane while it's in
- 41:21the air. It's already happening and it's.
- 41:24Getting better and faster all the time.
- 41:26Next month my partner may not be able to detect a Facebook chat
- 41:30bot at all in six months or a year.
- 41:32Maybe because they are getting better every day.
- 41:35And this is literally the crux of the Terminator.
- 41:38We are in Terminator times. Don't ever give anyone some
- 41:41gargoyle sunglasses and we'll be okay.
- 41:45I remember, I remember maybe a few years ago, I had a client
- 41:48who said, are you afraid that you're going to be out of a job
- 41:51as a result of AI? Because people can get the same
- 41:55solid advice from an AI chat bot that they can get from you, a
- 41:59human being licensed clinical therapist.
- 42:03And maybe one day that will be true.
- 42:05But I think it's going to be a lot of days between now and
- 42:08then. There really is no substitute
- 42:10for a human being. And all of this makes me really
- 42:14sad. I feel like we have really done
- 42:16and a disservice to our young men by creating yet another
- 42:18reason to silo them and keep them out of the population.
- 42:22I just feel like our society is becoming so separate and
- 42:27isolated and strange and I hope that we do some kind of 180 and
- 42:32figure it out before we end up being married to human pillows.
- 42:37Part of it is the social media landscape, the AI bots, the
- 42:41games, the interactions you have on your phone.
- 42:44They're like junk food. They're so bright and shiny and
- 42:48have very little nutritious value, but they're designed for
- 42:51us to be attracted to them. Right.
- 42:54TikTok is not designed for me to be mentally stable and, well,
- 42:57TikTok is designed to keep me on the app for as long as humanly
- 43:00possible. Then they're going to shame me
- 43:02when I'm on there too long. There's no substitute for
- 43:05humans. There's no substitute for
- 43:07licensed professionals. Because my goal when I went to
- 43:10school was not to learn how to keep people engaged and keep
- 43:13their eyeballs on me. My goal was to help people get
- 43:16better. I think we just have to figure
- 43:18out what new goals we want as a society.
- 43:21And I think that goal is hurting our podcast.
- 43:23We should be trying to keep people engaged and broadcasting
- 43:2614 hours a day. Have you seen the new Grok
- 43:29chatbot? Yeah, she looks like a Lolita
- 43:31maid. And she says super inappropriate
- 43:34stuff. If we had a podcast with her on
- 43:36it, I think it would be very popular, but I think it would
- 43:38probably be doing the wrong thing for society.
- 43:41Virginia, if somebody wants to not cry all night long about
- 43:44about the decline in our culture, where do you think they
- 43:48could find out more about your comedy?
- 43:50Let's enjoy the last six weeks that I'm allowed to do comedy
- 43:55before the inevitable government shutdown.
- 43:58I'm at 111.badiniabadinia.com. You can find essays.
- 44:04You can find links to everywhere I am on the Internet.
- 44:06You can find a calendar of where I'm going to be next.
- 44:08You can find my TikTok at Badinia.
- 44:10I'm taking a little break from TikTok while I heal an injury
- 44:13that I did to my face on a bicycle.
- 44:15I'll be back soon. And my Instagram is also
- 44:18Badinia. We mentioned before that you can
- 44:20write us at Hello at mysisters@therapist.com.
- 44:23But did you know you can also write us at Hire us at
- 44:26mysisters@therapist.com, especially if you want to give
- 44:28us products that we will then promote on the show, especially
- 44:31if those products are liquid Death Bitch and Sauce in Product
- 44:34Boots, Costco. You can also find us on
- 44:36Instagram at My Sister's A Therapist.
- 44:38You can find us on the web at woahwoahwoah.mysistersatherapist.com.
- 44:42You know the drill, Laura. Where can people find you on the
- 44:45Internet should they wish to? They can find me at
- 44:46lauraryan.org if they would like to work with me professionally
- 44:50and live in the state of Texas. They can also find me on my very
- 44:53silly Tiktok page. I am Laura Ryan, and I also want
- 44:57to find every listener #1 to talk to everyone you know that
- 45:01works at Liquid Death, but also #2 to tell every person that
- 45:06you've ever met that you love this podcast.
- 45:08And that you would like them to listen to it.
- 45:10Wise words, Laura, This is the part of the podcast where you
- 45:12sometimes read a nice review or comment or e-mail that someone
- 45:16has left us this week that enables us to continue living
- 45:20and making a podcast and feeling good about ourselves.
- 45:22Do you have one this week? I do this is an e-mail from
- 45:25Peter. I just listened to your Just Say
- 45:27No episode and I could write pages about how I can relate,
- 45:30but I'll spare you the effort of doing the emotional labor for a
- 45:33man Thank you Peter. Peter, you really get us,
- 45:36brother. I hope that today's guitar
- 45:38repair is going well, and as we close, we'd like to recall the
- 45:42words of our spiritual leader, who was not, and we'll never be
- 45:45a chat bot. Billy Ray Valentine, Capricorn
- 45:48as he said, We can make it, baby.
- 45:50Me and you. Bye.