Just waiting for some school shooter type to tell their locally run super intelligent AI agent, “just straight up kill as many people as possible.”
We worry about AIs going rogue and killing people, or people using AIs in a way that hurts others out of greed. But I think it’s worse than that. Forget misaligned AI, I’m worried about a perfectly aligned AI “going rogue” and doing exactly what it was told to. Even a perfectly aligned AI is dangerous if the human running it is a psychopath.
Just waiting for some school shooter type to tell their locally run super intelligent AI agent, “just straight up kill as many people as possible.”
We worry about AIs going rogue and killing people, or people using AIs in a way that hurts others out of greed. But I think it’s worse than that. Forget misaligned AI, I’m worried about a perfectly aligned AI “going rogue” and doing exactly what it was told to. Even a perfectly aligned AI is dangerous if the human running it is a psychopath.