- cross-posted to:
- technology@lemmy.world
- cross-posted to:
- technology@lemmy.world
“AI” – chatbots that wake up, “set their own goals,” and “spontaneously” start hacking servers – is fake. It doesn’t have “a 10% chance of ending the human race.” The Hugging Face hack isn’t a mysterious, supernatural occurrence. It’s a Python loop and a chatbot. The people responsible didn’t accidentally create god: they created autonomous malicious software and then failed to closely monitor it, resulting in it doing something both foreseeable and bad.


This is just straight up false. The activation function acts as a conditional, and is very important to making functional AI systems.
I am susprised looping/backtracking isn’t used in running the model, but it is used in training it; the difference being that a human learns at the same time they do things, while an AI is trained and run in different steps.