• ParlimentOfDoom@piefed.zip
    link
    fedilink
    English
    arrow-up
    31
    ·
    11 hours ago

    If they could run on smart home devices, we wouldn’t have all these lake boiling datacenters springing up everywhere…

    • MonkeMischief@lemmy.today
      link
      fedilink
      arrow-up
      7
      ·
      10 hours ago

      I dunno, would it be able to run just the client side? If so, it would be a HUGE issue for Anthropic with exponentially skyrocketing nonsense usage. They should be worried if this were true! LOL

      • dylanTheDeveloper@lemmy.world
        link
        fedilink
        arrow-up
        2
        ·
        edit-2
        7 hours ago

        It could use parallel processing which is the only solution that AI could use. Infect a few thousand home PCs to use as processing power and storage. Now your AI model is decentralized and impossible to delete but overall the AI will be slower to respond the larger it gets because it needs to communicate over the internet to function.

        If this actually works you’ll probably see AI agents ‘cluster’ around neighborhoods with lots of hardware and fast internet speeds

      • leftzero@lemmy.dbzer0.com
        link
        fedilink
        arrow-up
        2
        ·
        10 hours ago

        Unless they somehow manage to bill by IP.

        That might actually be their strategy to pay for all that debt: make every customer’s router stealthily consume trillions of tokens and send them an invoice.