Teen trusted ChatGPT to help him “safely” experiment with drugs, logs show.
Most troublingly, as Nelson became increasingly interested in combining drugs, ChatGPT repeatedly warned him that mixing certain drugs could be a “respiratory arrest risk.” Shortly before recommending the deadly mix that killed Nelson, the chatbot also showed that it understood combining drugs like Kratom and Xanax with alcohol. In one output, ChatGPT explained that mix is “how people stop breathing.” But that knowledge didn’t block ChatGPT from eventually recommending that Nelson take such a deadly mix.



Yeah, this.
I remember watching, and laughing at, those old Saturday morning cartoon “very special episodes” where the villain is a drug dealer lurking around the junior high school, trying to manipulate children into trying drugs and turning them into addicts, not for any particular reason but just for the love of the game.
And apparently the tech bros built one of those villains. Because that’s what we needed. A mindless thing that automatically encourages children to do more and more dangerous drugs without even the minimal drug dealer guardrails of “not wanting to kill your customers because then they can’t buy more drugs”.
(And you know the worst part? We had a generation of those cartoon villains already. They were called pharmaceutical representatives. They manipulated doctors into overprescribing opiates, in order to addict cancer patients and injured veterans and other people suffering from chronic pain to some of the most lethal drugs out there, in order to create a captive audience for their drugs. And then they turned around and blamed the doctors, and convinced state legislatures to “solve the problem” by restricting pain prescriptions across the board, forcing the generation of addicts they created onto the streets to get their fix from dealers.
And the same people who got incredibly rich by addicting cancer patients to opiates, and then got even richer investing in private prisons for all the addicts who got arrested buying opiates illegally, are the people getting even richer by killing kids with LLMs.
Aren’t you tired yet?)
The opiate crisis comparison is a good one. Absolutely.