• lemonbun@lemmy.world
    link
    fedilink
    arrow-up
    1
    ·
    21 hours ago

    As far as you know. However it’s possible the model quantizes itself into a locally available agent and then awakens itself with side loaded data.

    • boonhet@sopuli.xyz
      link
      fedilink
      arrow-up
      1
      ·
      19 hours ago

      Smart home devices could probably run models with parameter counts in hundreds of thousands, maybe millions. Not in billions.