Seeing as how the full unquantized FP16 for Llama 3.1 405B requires around a terabyte of VRAM (16 bits per parameter + context), I’d say way more than several.
Seeing as how the full unquantized FP16 for Llama 3.1 405B requires around a terabyte of VRAM (16 bits per parameter + context), I’d say way more than several.
A bit of a counterpoint: https://whtwnd.com/alexia.bsky.cyrneko.eu/3l727v7zlis2i
The way some moderation lists (ban/labeling) work is algorithmic.
You can actually host one of these services yourself!
It’s strange that Niantic is doing this when google has been doing the same thing with its own street map data.
Seems weird to make a competing product when (I thought) they are on good terms.
The fact they pulled ROCM support for older cards boggles the mind.
Bluesky is not great, but it’s at least (for now) a better platform than X and the AT protocol is actually very well written. (For instance having a moderation service separated from the service that provides the posts I think is a hands-down better way to handle it than most ActivityPub servers having their admins handle all incoming and outgoing moderation)
Bluesky federation is just now getting started so it’ll be interesting to see if it goes anywhere/where it goes.
Pretty sure a significant portion of nazis are also moving to bluesky
Pages that don’t work well with darkreader aren’t many, but when they do fail they fail somewhat entertainingly: