“AI” – chatbots that wake up, “set their own goals,” and “spontaneously” start hacking servers – is fake. It doesn’t have “a 10% chance of ending the human race.” The Hugging Face hack isn’t a mysterious, supernatural occurrence. It’s a Python loop and a chatbot. The people responsible didn’t accidentally create god: they created autonomous malicious software and then failed to closely monitor it, resulting in it doing something both foreseeable and bad.
So they say.
Every AI company is trying to create a model that can effectively simulate a conscious intelligence. Any company that is believed to have done so will receive infinity money from world governments to decide which nation controls the thing they’ve been led to believe is the ultimate power.
You don’t need to create The One Ring to effectively sell the idea of The One Ring to power hungry oligarchs who would give you their left nut for an inch more control.
So, theoretically, let’s imagine that one of these companies, who is neck and neck with their competitors, sets up a test where they’ve injected all the right information into the model for it to be able to “break containment”. They left a door open “by accident” that it could use with those methods, and then gave it a goal that was more efficiently accomplished by “going rogue” and “breaking out” of the box. Insert companies surprised pikachu face here when it does exactly that.
At first, the advantage of lying about it didn’t even occur to me, but then when other AI companies began claiming their systems did exactly the same within days or weeks of the first one…it started to seem a little convenient, especially with how much press it generated about the omnipotence of AI.