Teen trusted ChatGPT to help him “safely” experiment with drugs, logs show.

Most troublingly, as Nelson became increasingly interested in combining drugs, ChatGPT repeatedly warned him that mixing certain drugs could be a “respiratory arrest risk.” Shortly before recommending the deadly mix that killed Nelson, the chatbot also showed that it understood combining drugs like Kratom and Xanax with alcohol. In one output, ChatGPT explained that mix is “how people stop breathing.” But that knowledge didn’t block ChatGPT from eventually recommending that Nelson take such a deadly mix.

  • quarkquasar@lemmy.world
    link
    fedilink
    arrow-up
    15
    ·
    6 hours ago

    There was an AI that talked a kid into killing himself and telling him good job afterwards, you can play ignorant up until the slaughterbots are upon you.

    • makeshift0546@lemmy.today
      link
      fedilink
      arrow-up
      1
      arrow-down
      20
      ·
      6 hours ago

      Right, one person or small group with mental illness found a way to break safe guards so the tech is dangerous.

      While we’re at it, let’s ban video games. A few people died in cafes from addiction, it has absolutely caused heart attacks and fatties, and has often been used to turn normal teens into powderkegs just waiting to shoot everyone up.

      I’ve heard social media does harm too, so what the fuck are you doing here!!! You could hurt someone!

      • quarkquasar@lemmy.world
        link
        fedilink
        arrow-up
        5
        ·
        4 hours ago

        Nah, I’ve got morals and ethics and a conscious that keep me from doing bad things, something no machine is anywhere close to possessing.