Cross posted from https://sh.itjust.works/post/64317237
Sam Altman claimed we’re already living through the singularity. Is it true, or is it just marketing? Just days before, one of OpenAI’s models escaped from a testing environment and ended up hacking another company’s servers on its own. We analyze how real that claim is and what the experts say.
And from there, we jump to something bigger: can artificial intelligence have a soul? We delve into the debate that has divided physicists, neuroscientists, and philosophers, from Roger Penrose’s quantum theory to the arguments of Sean Carroll and Max Tegmark, including integrated information theory and the thermodynamics of life. Spoiler alert: even physics can’t agree.



An llm can and will not have an own conscience or motivation or even possibility of acting of its own.
It can only act triggered and the rest looks like it would be so, but its only parroting.
Downvotes or not, it is factually missing parts to get there.
Its like saying the currently most advanced self driving car is possible to develop into knight riders kitt. It’s not biology. It needs the components to be able to.
This is about the consequences of recursively training AI on AI-generated content. It doesn’t have anything to do with volition or true intelligence. There’s a good article about it here.