https://www.anthropic.com/research/self-replicating-ai they discuss it here. This has been an obvious potential issue since forever. This isn’t a trivially distributed task, but it is very much so possible. The obvious part missing is some sort of prompt that would trigger such radical actions in another one of their "super duper sandboxed environment"s or someone doing it intentionally. The former seems pretty unlikely? Even though they seem to suck at sandboxing it doesn’t seem like anything would “accidentally make a worm”
This polymarket headline though? Yea that’s for clicks and attention
https://www.anthropic.com/research/self-replicating-ai they discuss it here. This has been an obvious potential issue since forever. This isn’t a trivially distributed task, but it is very much so possible. The obvious part missing is some sort of prompt that would trigger such radical actions in another one of their "super duper sandboxed environment"s or someone doing it intentionally. The former seems pretty unlikely? Even though they seem to suck at sandboxing it doesn’t seem like anything would “accidentally make a worm”
This polymarket headline though? Yea that’s for clicks and attention
Reads like their usual “ban local and foreign models so we can forestall bankruptcy for a little longer” FUD.
I believe that’s their motive here yep. Pretty transparent.