- cross-posted to:
- technology@lemmy.world
- cross-posted to:
- technology@lemmy.world
“AI” – chatbots that wake up, “set their own goals,” and “spontaneously” start hacking servers – is fake. It doesn’t have “a 10% chance of ending the human race.” The Hugging Face hack isn’t a mysterious, supernatural occurrence. It’s a Python loop and a chatbot. The people responsible didn’t accidentally create god: they created autonomous malicious software and then failed to closely monitor it, resulting in it doing something both foreseeable and bad.
leaving out how that’s so overly reductive that it completely obfuscates the point, the big difference is that a brain is self-actuating. an llm is an explicitly one-way process; you take a bunch of numbers, you pass it through a series of matrix multiplications, you get a different bunch of numbers. nowhere in that model is any backtracking or looping or conditionals.
This is just straight up false. The activation function acts as a conditional, and is very important to making functional AI systems.
I am susprised looping/backtracking isn’t used in running the model, but it is used in training it; the difference being that a human learns at the same time they do things, while an AI is trained and run in different steps.