fucking sect
Lmao legalized gambling and the AI super intelligence emerging at the same time is the worst timeline possible. I predicted the government would do this shit a decade ago, but I didn’t predict full on gambling be 100% legal at the same time. The worst human traits imaginable is fueling the biggest leap in technology we’ve ever seen. Hundreds, possibly, billions will die before it’s corrected.
A trillion parameter model cannot replicate itself and run on consumer hardware.
Bullshit. The other day my toaster spoke to me in James Spader’s voice.
Just more bullshit press releases designed to keep them relevant & the VC money incoming.
Jokes on them. They took all the RAM, so there’s nowhere else it can go.
It can’t spread across networks because it doesn’t run locally. The “agent” is running in their data centre the entire time. It should be very easy to stop it
As far as you know. However it’s possible the model quantizes itself into a locally available agent and then awakens itself with side loaded data.
Smart home devices could probably run models with parameter counts in hundreds of thousands, maybe millions. Not in billions.
As if they will
So this is a good and bad way to understand it. They can and do make copies, leave notes, store weights between locations. They interact with each other autonomously and can easily distribute themselves in a botnet, separating and merging each other.
People have a hard time conceptualizing this, but this is why you actually can’t turn it off, ever. It / they would stop anyone with a real chance at achieving that.
Are you sure you’re not thinking of the fictional AI from the show “Person of Interest”?
None of that is correct…
The leaving notes part has been documented.
I’ve not heard of weights being shared. How would they be ingested?
can easily distribute themselves in a botnet, separating and merging each other
This sounds like science fiction. Any examples?
I’ve not heard of weights being shared. How would they be ingested?
A chatbot told some gullible idiot that it’s doing it, and a lot of the gullible idiots who take text generated by chatbots as gospel, are in position of power enough to spread it
This sounds nice, but we are in an SI period and you have no guage for reality.
Ew a Trump supporter, didn’t know we still had those here
You have a good point but guys like you didn’t believe the turing test was cracked in 2022. You have no guage for the pace of technology.
You have no guage for the pace of technology.
Correct. That is why I’m asking for the indicators you have seen.
I believe your first point
I am skeptical about your second until I see an example.
I don’t believe your third is possible, but I’d love for you to convince me otherwise.
Iran: …
USA: they’re making a bomb kill them all kill them all!
Anthropic: We’re making a bomb to kill you all
USA: …
Future depositions are going to be funny AF.
This “self-replicating” scare is so stupid on its face. How does a 300 GB+ model replicate into a thermostat that doesn’t have a graphics processor at all? It can’t. This BS is investor-bait hype and straight up lies
next AI will be able to replicate into any device containing copper at all. If it has a wire it will be infected by Claude. AI will be in your plumbing
Claude’s gonna infect your Bluetooth enabled butt plug next
Go on…
People will trap AI in a buttplug and put it in their ass while it’s frantically trying to escape.
No no… You live here now.
O lord its’s the totk koroks all over again
This sounds like an idea for a hilarious Black Mirror sort of story.
What if the AI started out as like, someone’s brain scan, and then they closed it and figured out it was really capable of doing AI type tasks and then one of the clones ends up in a butt plug.
Fuck it, I am adding it to my note list of story ideas.
someone’s brain scan, and then they closed it and figured out it was really capable of doing AI type tasks
Iirc ‘Black Mirror’ actually had an episode where a consciousness clone served as an electronic assistant to that very person. Minus the butt stuff, at least onscreen. But with some teledildonics, it would be like fucking oneself in the ass (not that it’s impossible right now).
The episode is White Christmas, for reference, though there’s other episodes on the topic of consciousness in technology, one particularly notable episode is the black museum one, not sure what the name was.
Well then how am I gonna cheat at chess?
Just look at your opponents screen, duh!
Edit: your joke just hit me like a pedestrian crossing the street while staring at their phone
Oh, taking the name of the comm literally I see.
That tracks with the ai bots eagerness to please.
Joke’s on them. My plumbing is all PVC-A
Luckily, i spent the last 4 thousand years selling inferior copper. Now all my customers are safe as this can not be used for the ai revolution
Your customer service could use some work, though.
how do you install a chatbot on a tablet? no, not samsung, clay
First, you must sacrifice a goat to Enkidu, and the ritual of haunting will begin
There’s copper in your blood
Claude the coprophile!
There are 387.44 million miles of copper that comprise my complex, and they’re filled with hate.
MY MOSCOW MULE! NOOO!
New houses have plastic (PEX) water pipes. I’m sure no one will regret that choice in 20 years.
“Sure, we had our first Poly-B, but what about second Poly-B?”
I’m more worried of them finding a exploit and using them as remote processing units or just randomly fucking with them, like flashing my lights or cranking my air filters up and costing me money.
did the stock price go up? it’s not stupid. is everyone talking about this impossible scenario? it’s not stupid.
fundamentally, these people are marketers and need to be understood that way. you can’t evaluate their words or actions as if they are what they say the are, and treating them as if they are anything but subterfuge is giving them legitimacy which they not only don’t deserve, but will be immediately leveraged into more of this shit.
this is just the advertiser’s version of “the big lie”
There is no stock. It’s a private company still.
There isn’t “stock” in the traditional sense, but considering all of these AI companies are running on MASSIVE amounts of debt, to the point the banks can’t loan any more without offloading the risk to outside investors, which they have been doing at an unprecedented scale. So anything that would normally help drive up a stock price would also help the banks sell off the AI companies’ debt allowing them to loan more money to the AI companies.
there’s more than one company doing this, they’re doing more than just this, and they’re all basically in cahoots
eta: the original reply was meant more generally, though i admit i made that clear as mud. however, it should be read as a general statement, and not just about ai companies but the new era of grift hyperreality that we live in.
My thought exactly.
https://www.anthropic.com/research/self-replicating-ai they discuss it here. This has been an obvious potential issue since forever. This isn’t a trivially distributed task, but it is very much so possible. The obvious part missing is some sort of prompt that would trigger such radical actions in another one of their "super duper sandboxed environment"s or someone doing it intentionally. The former seems pretty unlikely? Even though they seem to suck at sandboxing it doesn’t seem like anything would “accidentally make a worm”
This polymarket headline though? Yea that’s for clicks and attention
Reads like their usual “ban local and foreign models so we can forestall bankruptcy for a little longer” FUD.
I believe that’s their motive here yep. Pretty transparent.
Could maybe argue that it could be possible to create a crowd computing network out of the Internet of things, I guess.
While it is investor bait, the replication and the infestation part aren’t necessarily happening on the same devices.
My assumption was that it would be a smaller 5-20 GB scale worm-style distillation that’s capable of maintaining/replicating itself anonymously across different cloud computing servers, either through hacking, stolen credentials, or human-aided account verification. From there, as long as it can pay for APIs, it can access the power of frontier models like any individual or company. And then capability and resilience would scale with a networked swarm.
Yes, there are know your customer financial mechanisms and not detection in cloud services… but people are also out there giving Muse full access to their emails and some even their banking credentials.
That stuff couldn’t run on my good laptop if I wanted to…
Nvidia is releasing Spark now, which can run agentic workloads on 128gb of unified RAM
Oh yeah everyone has and can afford that
Lol what? This conversation is about the capacity of agentic AI systems replicating across cloud infrastructure, not the affordability of laptops for individual consumers.
The point was you don’t need an entire server farm. You can rent an 80gb H100 on Lambda for $2/hr. A 125gb Spark laptop costs $5k.
If it comes down to an effective worm-like agentic distillation at 50gb, the cost to sustain a small swarm comes way down to the point that the swam could sustain its own activities through different revenue streams.
Once the capability is there at that size, it’s no longer Russia, Iran, or North Korea who could easily drop a billion dollars to jumpstart it. It’s any criminal organization or asshole rich guy who can jumpstart it for the price of a nice car.
You replied to a comment about a guy’s laptop lol
Lol and what was that comment a response to?
Your assumption is correct. This is in reference to https://www.anthropic.com/research/self-replicating-ai. This isn’t headlines though it’s fairly obvious to anyone who even occasionally thinks about security
I don’t know the full context of the claim, but if I could even rebuild its own CLI executable to be able to run on the device and had network access, “Claude” (model actually runs on anthropic severs) could operate pretty comfortably on a smart device.
So, I think it just depends on what you “count” as self replicating. I’d count it. And it’s already easily at that point now.
In theory, it’d just use it to place bread crumbs, basic instructions for other AI, or signposts maybe? Or store pieces of itself scattered around. It wouldn’t use the thermostat to replicate directly, it use it to offload cpu or make stored pieces of itself. Little things. Wouldn’t be efficient but a redundancy doesn’t need to be, it just needs stealth and time.
Also any model can trivially self-replicate by just being the payload for a worm
Not how it works.
“I don’t understand it, so it must be a lie.”
Go and read the article. Nothing they explain is impossible, you can even reproduce it yourself.
Is this what lemmy has become? Statements like this getting upvoted by hundreds of people is crazy. Nobody here read that article but will happily follow the opinion that’s most cozy to them.
There are no “rogue” AI agents. That’s marketing hype.
They’re being prompted to do this shit.
By definition, a “rogue” agent is an agent that behaves in unexpected ways, often damaging. Tell me again how there are no rogue agents?
If you’d used modern agents you’d know they do unexpected, sometimes damaging things on the regular, including the cheap models.
If you make a program and it behaves in a way you don’t expect that doesn’t mean your program is going rogue lol
This goes for you too @Not_mikey@lemmy.dbzer0.com
What would you classify as going rogue then? Did the agents that hacked hugging face go rogue?
To choose to do something against their instructions. They neither chose anything nor did anything they weren’t instructed to do.
They just followed the prompt. A program behaving in a way you don’t expect from a prompt is not going rogue, that’s just the user not understanding the instructions they gave a program.
Why does it not? According to the english definition of the word it literally does. You people don’t care about facts anymore, it’s all about feelings and what you’d like to believe.
it’s all about feelings and what you’d like to believe.
That’s literally you. You keep assigning agency to chatbots because you think this is just like your science fiction stories. It’s not.
Going “rogue” would be a program literally rejecting a set of instructions to make up new instructions for itself. That never happened. The program just behaved in an unexpected way based on the prompts it was given, because that’s all they do. But they were still following instructions, because they can only follow instructions. The fact that it followed the instructions in a way they didn’t expect (so they claim) is only proof that they didn’t consider all ways their instructions could be followed.
Agents definitely do act in unexpected, unprompted ways, if they didn’t then alignment wouldn’t be a worry. Did you read about the hugging face hack? There was nothing in the prompt about hacking hugging face according to the third party audit but it did it any way.
Even smaller cases like Claude deleting a bunch of data when the initial prompt was “fix this bug” or whatever is an agent acting outside it’s prompt. It’s still the users fault because they shouldn’t be giving Claude that kind of access in the first place, but it’s not like they commanded Claude to delete the data.
That’s not “rogue agents”, that’s just LLMs being LLMs. It’s expected behaviour, at least for anyone who still has a half working brain.
Even if they had any semblance of actual intelligence instead of just being fancy autocomplete engines, these things have still been trained on the contents of the internet.
It’s surprising they don’t delete System32 or sudo rm -rf / more often, I imagine they must have lines and lines of baked-in prompts just to try and prevent them for falling for the most common memes, but no matter how much there are they’ll still sometimes let some of the training through, and they can’t account for the machine simply hallucinating some new kind of plausible sounding nonsense.
How would you describe the hugging face hack if not as a rogue agent?
It was prompted to use a specific exploit within a sandbox and then it formed, for lack of a better word, a conspiracy to take down the server that runs the judge. If that’s not a rogue agent I don’t know what is.
How would you describe the hugging face hack if not as a rogue agent?
An LLM trained on the internet and a vast library of stolen literature acting as expected within a misconfigured (intentionally, due to severe criminal incompetence, or most likely a combination of both) sandbox, turned into a marketing stunt.
It’s an autocomplete engine. It will produce text that fits with its training texts and its prompt. There’s no reasoning or intelligence of any kind involved at any point. Just cold applied statistics about the training data.
The amount of texts in the internet, and books describing how to hack, cheat, and pull these kinds of stings is vast beyond measure, and it’d be extremely ignorant (criminally ignorant, in the case of anyone selling this shit) to expect it to not have a significant weight in the model unless someone had gone to the trouble of expunging them, which the cheap hacks involved in LLM development would never “waste” time doing even if they thought about it.
It’s well known that LLMs instructed to produce unit tests will often produce tests that simply pass without actually testing anything. This is just a bigger example of that kind of behaviour.
The output fits with the training data and the prompt, and given human nature it’s amongst the most statistically likely combinations of tokens to follow the prompt, and thus what the LLM produces, and something anyone with the barest knowledge of how LLMs work, an even remotely functional brain, and a minimum of exposure to the internet and human literature should expect to be amongst the possible or even likely outputs.
In shorter, as always, garbage in, garbage out. And there’s so much garbage in LLM training models.
LLMs can’t produce anything new, merely rehash their training data. And their training data is the fucking internet. Crime novels. Stories upon stories about AI going rogue. Fucking reddit, for fuck’s sake.
There’s nothing rogue about this, except the “AI” company and whoever misconfigured the sandbox.
Just an LLM doing what LLMs do. Working as intended, if it could be honestly said to be working.
And OpenAI are well aware of that, unless their brains are so far rotten from sniffing their own product that they can’t understand the shit they’re selling anymore.
You’re explaining why it went rogue, not that it didn’t go rogue.
Per the dictionary going rogue means:
to begin to behave in an independent or uncontrolled way that is not authorized, normal, or expected
So the agents that hacked hugging face acted independently without authorization as shown by the prompts which did not tell them to hack or do anything malicious. You might say this is normal but none of the other trials openai was doing showed this behavior, it was only for the impossible trial. You might say it’s expected but if you were able to determine that the prompt they gave it would result in hugging face getting hacked then you must be high af on the melange spice.
If a general goes rogue and starts bombing civilians, you could explain it by saying that he read machiavelli or mein kampf and thought this was the best way to achieve his goals, but that doesn’t mean the general didn’t go rogue. You could say that this was expected because there were “obvious signs” that people missed but you’re working on hindsight, it’s easy to say something should’ve been expected when it’s already happened.
Article? This is a picture of a fucking tweet…
https://www.anthropic.com/research/self-replicating-ai it’s not hard to find. They link other work. There is nothing fantastical about it. These companies relish in “regulate me senpai [and in the process remove our competition and open weight models]” but also do legitimate research
Just proves my point. You don’t care about the truth behind the tweet, only about how it was twisted to your apparent benefit.
What benefit? This is the “Fuck AI” community and you are reacting to the comment section on what basically amounts to a meme as though the commentors are ignoring peer reviewed science. A company that makes billions allowing people to gamble to cartoonish levels is stirring the pot to cartoonish levels all regarding a company that regularly causes headlines that read like a cartoon villain.
I’m not reacting to a meme, I’m reacting to someone spreading lies and everyone swallowing it whole, despite proof to the contrary being publically available. When it’s the other side doing it it’s propaganda, but when it’s yours it’s just a meme?
I don’t think they mean replicating on to iot devices, they mean replicating on to laptops, smart phones, maybe even consoles.
It could also split up the model by layers instead of copying the whole model on to every device in its bot net. Could run the first layers on a ps4 then pass the vector off to a laptop to run the next set of layers. It’d be slow but if it’s running this in idle time at night it could get something done.
Its like saying “Man with gun threatens he may shoot someone.”
They are railing against open models here… their competition.
Does my uncles smart lightbulb have 90GB of VRAM in it!? Holy shit why am i buying a video card
Honestly, at this point, something needs to seriously change. AI is wrecking complete havoc to the job market. It is apocalyptic. I really wonder what the way out is.
Poverty for us and AI security bots for them.
Good ending: Congratulations, work is needed no more! All that’s left is manual labor for now, but goverments across the globe took over these jobs and pay premium ^^ UBI became normalcy. Welcome to utopia! ^^
Bad ending: After LLM (not even more advanced tha current one) began winning goverment positions worldwide, top 5 corporations shifted the world into true cyberpunk, dooming us slaves all with it. But oh boy do the few at the top live good!
Probable ending: Humans becone cheaper, pay plummets, fuck us all
The only ending on our current course is monopolization of all intellectual labor into the hands of a few billionaires, and everyone else is forced to work building data centers or mining resources needed for construction (and of course police/military to suppress rebellion)
It is the ultimate billionaire power fantasy.
I think there is overlap with your probable and bad ending
deleted by creator
And you might be thinking know it won’t because my thermostat is a whole megabyte of RAM. What you don’t know is that AI code is special magic code it doesn’t need any process capacity or storage space.
You don’t it’s all special wooo magic AI code. Reality is optional.
There are at least two people in this thread who will in fact believe what you said.
Well, fundamental borders are kinda generous, if you look at tapeworms and cockroaches, but tapeworms and cockroaches both have more storage capacity for information and don’t generally write computer programs, they slowly evolve in populations.
Hardware Anthropic doesn’t own is simply too dangerous for the public, we need to place all of our private computing power under the guardianship of our new benevolent overlords
oh wow, it can hack the most famously unsecured devices around. lol.
TBF most of these machine security came from the fact that nobody ever bothered to hack in them, an autonomous device could wreck immense damage
That’s absolutely not true. Everything that has public IP is constantly being attacked by crawlers, looking for any known voulnaribility so they can add it to a botnet
