• CharlesDarwin@lemmy.worldOP
    link
    fedilink
    English
    arrow-up
    2
    ·
    1 day ago

    It’s hyped to all hell, but I think it will ultimately settle down to something used for many things and be mostly just assumed. But I doubt all this spend from hyperscalers will ultimately pay out the way it’s being framed.

    My guess? Things get scaled down so much that for most purposes, even where you might use a “frontier” model now, you could use a local model and get enough token/sec.