- cross-posted to:
- technology@lemmy.world
- cross-posted to:
- technology@lemmy.world
“AI” – chatbots that wake up, “set their own goals,” and “spontaneously” start hacking servers – is fake. It doesn’t have “a 10% chance of ending the human race.” The Hugging Face hack isn’t a mysterious, supernatural occurrence. It’s a Python loop and a chatbot. The people responsible didn’t accidentally create god: they created autonomous malicious software and then failed to closely monitor it, resulting in it doing something both foreseeable and bad.
I can run models comparable to that locally on my machine if I wanted to. I haven’t read the numbers so I guess I won’t argue this point but I do find it at least very surprising.
Open weight / free models are largely where the innovation in the models is actually happening (which makes sense because it’s where it has to). OpenAI and to a lesser extent Anthropic are money furnaces that long ago gave up on efficiency and much prefer to stuff trillions of parameters into a model that can only be run if we trap the sun in a dyson sphere or whatever.
Chuckling sadly at the idea of some aliens pulling up to the solar syatem and all they see is a giant carbon nanotube ring that says “What can I assist you with today?”