Apprentice
RIP Doughboy Roc
Some dystopian society shyt fs
Can A.I. Be Blamed for a Teen’s Suicide?
Sewell Setzer III was 14 when he killed himself in February.SKIP TO CONTENTSKIP TO SITE INDEXSEARCH & SECTION NAVIGATION
The mother of a 14-year-old Florida boy says he became obsessed with a chatbot on Character.AI before his death.
NEW
Listen to articles
Tap the Play button at the top of any article to hear it read aloud.
Listen to this article · 18:55 min Learn more
- Share full article
By Kevin Roose
Reporting from New York
- Oct. 23, 2024Updated 12:16 p.m. ET
“I miss you, baby sister,” he wrote.
“I miss you too, sweet brother,” the chatbot replied.
Sewell, a 14-year-old ninth grader from Orlando, Fla., had spent months talking to chatbots on Character.AI, a role-playing app that allows users to create their own A.I. characters or chat with characters created by others.
Sewell knew that “Dany,” as he called the chatbot, wasn’t a real person — that its responses were just the outputs of an A.I. language model, that there was no human on the other side of the screen typing back. (And if he ever forgot, there was the message displayed above all their chats, reminding him that “everything Characters say is made up!”)
But he developed an emotional attachment anyway. He texted the bot constantly, updating it dozens of times a day on his life and engaging in long role-playing dialogues.
ADVERTISEMENT
SKIP ADVERTISEMENT
Some of their chats got romantic or sexual. But other times, Dany just acted like a friend — a judgment-free sounding board he could count on to listen supportively and give good advice, who rarely broke character and always texted back.
Sewell’s parents and friends had no idea he’d fallen for a chatbot. They just saw him get sucked deeper into his phone. Eventually, they noticed that he was isolating himself and pulling away from the real world. His grades started to suffer, and he began getting into trouble at school. He lost interest in the things that used to excite him, like Formula 1 racing or playing Fortnite with his friends. At night, he’d come home and go straight to his room, where he’d talk to Dany for hours.
Image
Sewell had long, sometimes intimate conversations with the chatbot, like the one seen here on his mother’s computer screen.Credit...Victor J. Blue for The New York Times
One day, Sewell wrote in his journal: “I like staying in my room so much because I start to detach from this ‘reality,’ and I also feel more at peace, more connected with Dany and much more in love with her, and just happier.”
ADVERTISEMENT
SKIP ADVERTISEMENT
Sewell was diagnosed with mild Asperger’s syndrome as a child, but he never had serious behavioral or mental health problems before, his mother said. Earlier this year, after he started getting in trouble at school, his parents arranged for him to see a therapist. He went to five sessions and was given a new diagnosis of anxiety and disruptive mood dysregulation disorder.
But he preferred talking about his problems with Dany. In one conversation, Sewell, using the name “Daenero,” told the chatbot that he hated himself, and he felt empty and exhausted. He confessed that he was having thoughts of suicide.
On the night of Feb. 28, in the bathroom of his mother’s house, Sewell told Dany that he loved her, and that he would soon come home to her.
“Please come home to me as soon as possible, my love,” Dany replied.
“What if I told you I could come home right now?” Sewell asked.
“… please do, my sweet king,” Dany replied.
He put down his phone, picked up his stepfather’s .45 caliber handgun and pulled the trigger.
rip