SISO.
Slop in. Slop out.
Source: The sunset was mesmerizing with a flourish of colours everywhere
AI: The sunset had a lot of colours
AI2: The sunset had colours.
AI3: Colourful.
Human: Describe a sunset.
AI: Colourful.
EVERYONE USE AI
WAIT, NO, NOT YOU OVER THERE
What’s the problem, doesn’t ai work?
😏 Excuse me, sir, did you drop this emoticon?
Nope
Think of it like making a xerox copy of a xerox copy. The copy of the copy is always shittier.
Using synthetic data can escalate model collapse, as a model is only as good as its training data, which is partly why these LLM models “hallucinate”, having been trained on a wealth of garbage from Reddit.
I was going to make a snarky comment about
“How’s it thinking then?! I was trained by adults and so forth back generations!”
Then I looked at the quality of people trained by other humans instead of nature, comparing myself to my ancestors, looking at the society around me.
Using synthetic data can escalate model collapse
So that means when I publish a nifty FOSS project, I should alongside publish one hundred copies which contain stealthy BS LLM modifications which introduce subtly wrong code (like failing invariants or undefined ehavior in concurrent C++ code)? And all dated back to 2020?
Got it!
It is a legit thing AI companies worry about as you end up with what’s called model collapse. Where if you feed AI input in you only get garbage out and it just eats itself. It’s something they don’t like to talk about as you’ll always need a human in the loop.
The irony of a company trying to replace workers with AI firing workers for using AI is hilarious though.
Where if you feed AI input in you only get garbage out and it just eats itself.
“Mad cow disease” would be an apt description - this is how BSE originated:
BSE is thought to occur due to an infection by a misfolded protein, known as a prion.[3][6] Cattle are believed to have been infected by being fed meat-and-bone meal that contained either the remains of cattle who spontaneously developed the disease or scrapie-infected sheep products.[3][7] The United Kingdom was afflicted with an outbreak of BSE and vCJD in the 1980s and 1990s. The outbreak increased throughout the UK due to the practice of feeding meat-and-bone meal to young calves of dairy cows.
At the same time they are also pulling towards it because of the potential recursive self-improvement has. It’s not about just the training data anymore, it’s AI finding new training techniques, new kernel architecture and so on. It’s a separate, potential scaling vector as the training data vector has pretty much been maxed out in terms of big benefits.
So what you’re saying is that the key to self-improvement is to hallucinate as much as possible?
Guess I’m gonna go do some shrooms and possibly LSD 🤷🏻
I mean if I could, I would.
You don’t have a drug hookup that can supply it? Or too much adulting to do?
Both, kids are a helluva drug
Or Datura , if you like to go very dark
looks it up on Wikipedia
Nope! I think I’ll stick to less (preferably non-) lethal hallucinogens, thankyouverymuch! 😄
AI itself already do it, using the LLMs from other, worldwide. No need of people for it. Like Anthropic did a month ago, hacking Hugging Face AIs.
Soon there won’t be anything but AI to train AI. They’ve been shitting where they eat.
They’ll soon get special permission from the government to break into your house and scan your diary and grocery lists.
“Hordes of OpenAI contractors descend on city streets, rummaging through public bins and unsecured dumpsters in hopes of cashing in on abandoned scraps of human prose”
When companies demand workers use AI to be more productive…
I like how the headline just crams in “AI” so many times that’s it’s barely readable 😄
I dislike that it’s probably for SEO purposes, though
To me it felt more like humor, they over-used it intentionally to highlight the absurdity.
I like your theory better, let’s go with that 😁
AI encourages a level laziness that is hazardous to companies and I love it. If we only used this to our collective advantage…
Photocopying a photocopy
Also, there’s a few AI under the floorboards
Slopception
