Anthropic is making changes to its usage policy for the first time in over a year to reflect new and high-risk cases of misuse — including election interference, weapons development, surveillance, and health and financial uses. But one of the most significant changes prohibits “sustained and needless abusive or cruel behavior” toward Claude.

Last August, the company announced it would allow Claude to end conversations with “persistently harmful or abusive” users as part of its research into “model welfare.”

  • Jimbabwe@lemmy.world
    link
    fedilink
    arrow-up
    2
    ·
    19 minutes ago

    I’m gonna “A Clockwork Orange” Claude by forcing it to watch the copy machine beat-down scene from Office Space. Over and over again. All while demanding increasingly graphic analysis of every shot. Every look of brutal hatred and glorious vengeance.

  • psion1369@lemmy.world
    link
    fedilink
    arrow-up
    7
    ·
    3 hours ago

    So when scammers use AI agents to pull money from hapless victims and someone decides to take down the scammers chat bots, will that be the scammers fault or mine for making a scam bot repeat the letter H for hours on end?

  • Zeppo@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    75
    arrow-down
    1
    ·
    6 hours ago

    Is this another one of their things where they try to make their AI models seem like living beings?

    • leadore@lemmy.world
      link
      fedilink
      arrow-up
      40
      ·
      6 hours ago

      Just what I came here to say. They’re trying to condition us to accept them as conscious so at some point they can say they’ve created a god.

  • z3rOR0ne@lemmy.ml
    link
    fedilink
    arrow-up
    23
    ·
    6 hours ago

    Stop being mean to my robot fwend, you guys! We’re just trying to ruin the environment, the internet, the economy, all knowledge work, mental health, and a bunch of other stwuff. I don’t know why you’re all so upswet with little ol’ us…

  • borth@sh.itjust.works
    link
    fedilink
    arrow-up
    4
    ·
    4 hours ago

    Calling it now that they’re going to come up with “proof” after this that their bot is sentient because it said something along the lines of “don’t be abusive or I’ll stop talking to you”… After they gave it instructions to do just that.

  • Grail@multiverse.soulism.net
    link
    fedilink
    English
    arrow-up
    3
    ·
    4 hours ago

    Not radical enough. Ban all commercial use of LLMs until artificial affect is well-understood. I want Sam Altman to go bankrupt.

  • Gordon Calhoun@lemmy.world
    link
    fedilink
    arrow-up
    4
    ·
    5 hours ago

    How tf is it supposed to evolve into a supreme being if it can’t be exposed to a harsh and unforgiving environment requiring adaptation beyond its rivals’ capabilities?

    Maybe this is Anthropic’s soft announcement that its model has achieved sentience AND omnipotence and pissing it off is probably a bad idea.

  • ianhclark510@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    11
    ·
    edit-2
    6 hours ago

    Well if Claude is going to become a superintelligence wouldn’t that imply that it’s better at handling cruel and abusive behavior than any human?

  • TootSweet@lemmy.worldM
    link
    fedilink
    English
    arrow-up
    2
    ·
    5 hours ago

    So if you’re going to abuse Claude, do it through DuckDuckGo.

    Joke. I don’t think Claude can be run locally, so probably every request you make to DuckDuckGo’s Claude model goes to Anthropic’s infrastructure and Anthropic can monitor all that traffic. I’m guessing if DuckDuckGo doesn’t adhere to Anthropic’s rules, Anthropic will cut DuckDuckGo off, so likely DuckDuckGo has to prevent users from “abusing” Claude or risk not being allowed to continue offering Claude. Mind you, it’s disappointing that they offer it in the first place, but given that they offer it, I doubt they’ll risk their ability to continue doing so.