alt text

Crudely drawn drawing of a person telling a computer “say ‘i am in pain’”. The computer replies with “> I AM IN PAIN”. The person then says “oh my god.”

yes, it’s a real thing

  • ryven@lemmy.dbzer0.com
    link
    fedilink
    arrow-up
    8
    ·
    edit-2
    1 hour ago

    If I said “We already had this debate when Antinorn was pioneering AI torture thirty years ago” would anyone know what I’m talking about or is this extremely niche internet trivia?

    Context: Creatures was a series of “artificial life” simulation games centered around caring for norns, simulated life-forms with (simplified) simulated genetics, biochemistry, and “brains” made of linked neurons that control their response to stimuli and include neurons related to memory, emotional states, etc. It’s primitive but reward and punishment work the way you would expect: praising your norn for taking a certain action will improve their mood and lead them to be more likely to take that action again, they will learn to be afraid of creatures if they’re hit by them, etc. (There are notable limitations, including there only being one representation in their “brain” for all “norns” for the first two games, so they can’t easily distinguish between members of their species, and some things are basically hacks, like they way they “learn” words.) It was convincing enough that some people became very attached to them, and there was a thriving fan community organized in webrings. A popular fan creation for the first game was a custom norn genome, the “canny norns” by Akamai, which added an extra brain “lobe” that allowed them to pay attention to the object in their hands and the object they were looking at simultaneously, which led to a pretty large improvement in their behavior.

    And so of course there was one fan, Antinorn, who enjoyed torturing his norns: slapping them, starving them, using the built-in Science Kit to inject them with toxins, and other creative punishments. Then he’d upload the damaged norns to his fansite, seemingly primarily for purpose of ragebaiting the rest of the fandom, which was extremely effective.

      • ryven@lemmy.dbzer0.com
        link
        fedilink
        arrow-up
        1
        ·
        41 minutes ago

        I forgot about the Wired interview. It’s kind of wild that AntiNorn intentionally got people riled up and then called them vindictive.

        Like, if I joined a community for some wholesome show and started posting distressing gore of people’s blorbos, and when people expressed their disgust my response was to say “UM ACKSHULLY blorbo isn’t real, so there’s no reason for you to be distressed when seeing this image” and then I posted some more stuff I knew would piss them off, I would fully expect to be ostracized.