The employee, Mrinank Sharma, had led the Claude chatbot maker’s Safeguards Research Team since it was formed early last year and has been at the company since 2023.
“Throughout my time here, I’ve repeatedly seen how hard it is to truly let our values govern our actions,” Sharma said, claiming that employees “constantly face pressures to set aside what matters most.”
He also issued a crypic warning about the global state of affairs.
“I continuously find myself reckoning with our situation The world is in peril. And not just from AI, or bioweapons,” he wrote, “but from a whole series of interconnected crises unfolding in this very moment.”
The negative side has Kool-Aid? I assume you just refer to the fringe that make outrageous claims and not the “ordinary” doomers that realize if we’ve thrown out safety for profit with “just” LLMs, we’re absolutely going to go in full throttle with anything more.
I haven’t run across anyone involved in the safety aspects of AI in any form who is very happy or comfortable right now. There is a reason for that.
yeah, I meant the “old school” doomers who thought the AI would start to replicate and upgrade itself and turn into Skynet basically and humans would be helpless to stop it.
Now the likely doom is just Elon Musk running the planet and turning forests into data centers for 3D waifus. 🙃
The mindless paperclip scenario is far more likely, and if looked at the right way, it’s not only happening metaphorically, most humans are helping it.
He should probably get his porn addiction fixed. You’d think the richest guy on Earth woukd be in the best position to do so.