It has to be pure ignorance.
I only have used my works stupid llm tool a few times (hey, I have to give it a chance and actually try it before I form opinions)
Holy shit it’s bad. Every single time I use it I waste hours. Even simple tasks, it gets details wrong. I correct it constantly. Then I come back a couple months later, open the same module to do the same task, it gets it wrong again.
These aren’t even tools. They’re just shit. An idiot intern is better.
Its so angering people think this trash is good. Get ready for a lot of buildings and bridges to collapse because of young engineers trusting a slop machine to be accurate on details. We will look back on this as the worst era in computing.
Oooh buddy, is isn’t even young engineers using these to destroy their designs. I was at a building construction conference recently where one of the presentations was about how AI is going to “give us so much time back” as designers. He then told us about how the AIs hallucinate math still, and that the AI companies are not liable for their output. After the presentation, I and another person asked him a question about who exactly the liability will lie with and how someone could protect themselves from the liability without spending all the time we “save” meticulously checking the outputs. His response was to generate thousands of outputs for the same task and then only check “the best versions.” Okay, so how will we know which are the “best” without meticulously checking thousands of them?
Anyway, afterwards, I asked my colleagues from all around the country who were at the conference for their opinion on AI and the presentation, and most of these 50-60 year old men told me they regularly use it in their work already. So be prepare for things constructed in the past few years to be incredibly dangerous facilities to be in or near.
A previous job forced us to use them, I spent more time getting the damn thing to work than actually doing work
I think it really depends on the task.
There are folks who manage to have their whole careers be basically put stuff from documentation and stack overflow to implement very basic stuff over and over again, and pray it works and doesn’t need debugging. They hate coding, but it was heralded as a doctor/lawyer level pay but way easier to get into. LLMs can largely replace the work for those. These are humans I would never have trusted with anything significant, and only have them low stakes low risk stuff to keep them busy because management wants them utilized. Sure they spend a month to fall at delivering something basic, but management is happy enough.
Then there are folks who mostly live in code that is needed because it truly doesn’t already exist. Those folks will find LLM relatively less useful. Now those folks do end up with braindead chores on occasion. Change from library x to y because whole they both do the same thing, x got discontinued. LLM can be useful at accelerating that because it’s just so obvious but not quite as simple as search and replace. Or if you want to define some argv parsing you can let a codegen do that because it’s easy but tedious.
To go back to the days of car analogies. Imagine some tech people got the world excited because they created tools to automate engineering in motor sports. People even come out saying how it helped them engineer their own vehicle and stories saying the most prolific motor racing is being taken over. You as an F1 engineer see it as mostly useless, but everyone keeps talking about it’s going to replace engineers. Turns out everyone is actually taking about go karts and it is true that it works ok for that and that go karts are way more common than F1.
The problem is that to the world, programming is programming without distinction, and even the people in charge of the F1 type work don’t know the difference because they were never technical either.
I don’t really mind people using it for simple dumb tasks. I’m just sick of boosters saying how great it is. If you’re an intelligent person, you realize real fast how stupid it is at real work.
But we have destroyed the economy and planet and given all of our data to billionaires to do it. Not fucking worth it in the SLIGHTEST.
Maybe if THE PEOPLE owned all the data centers and models I could get behind it. But that’ll never happen.
This is why I’m hoping the bubble pops soon. Too many people trying to gaslight about the utility of it for their self interest.
If it were just “boringly useful, but not mind boggingly profitable somehow”, then I’m sure I’d no longer have a ton of people trying to micromanage use of LLM all around me.
Currently, my management has dictated that our failure to see “magic results” is because we just haven’t been trained enough, and are paying for and mandating for over 200 hours of training on how to use LLM correctly. The grift is insane, since the whole point of the LLM is that it shouldn’t need training to use, but here we are, people found a way to grift training on a ‘doesn’t need training’ solution that doesn’t work as advertised…
On a call with a partner, after demonstrating their software and everything it does, one of our executives kept insisting that they need to use LLM and then it would be even better.
So ready to have execs stop caring, and then maybe I’ll somehow appreciate the residual utility of it, whatever it is.
Generally I equate positivity about LLMs with people’s technical ability. I find the more they say AI is good the worse programmer they are.
Technical literacy in general. My friend thinks it’s the greatest thing ever, is an idiot with technology (and life in general).
It also says a lot about their inability to identify bullshit
Might be some dunnig kruger curve there. Not tooting my horn but I know my ways around and I only use ai for programming when I more or less know how it works already. Which means I verify and fix any eventual problems before committing any code. It does speed up the process, it’s a tiny bit simpler than checking stuff out on stack overflow IMO.
Now, if you don’t know your ways around, and “trusts” the outcome on an LLM, boy are you in trouble 😵💫.
every time I use it, i waste hours
Yes, exactly this. It looks good, I ask for it to tweak something. It tweaks, but now something else needs adjustment. Then it comes back unusable.
It ends up taking the same time as doing it myself. There’s some value perhaps in either the novelty or engagement that keeps me focused but it’s not more efficient.
When it does work, I’m always worried it is an illusion I’ve missed something. Like how you send an email and immediately see the typo.
People who love it, love it because they don’t need to or care about having accuracy and precision in their work. Sales and marketing, management, etc. Business idiots.
Ed ed ed!!!
you’re obviously prompting it wrong, and/or not using the latest models /s
People in this thread unironically saying this. Waiting for the “just wait half a year” model that will be so advanced
I still think back of Linkedin post I saw from someone talking about LLMs and throwing in the sentence:
”Apparently I am really great at making super prompts!”
Which is probably something the LLM told them and they have lost all self-reflection, so…
LLM: Wow, you are so good at this. Are you sure this is your first time? …Oh, prompt me harder, daddy.
Oh man I deleted LinkedIn last month, and March has been glorious.
I literally feel like there’s hope for humanity now. Like just a little glimmer of it. I didn’t even really use it, but it somehow sucked my soul and shattered it into 1,000 pieces.
There are right tools and wrong tools depending on the application.
There are right ways to use said tools and wrong ways…like you wouldn’t use a phillips head screwdriver on a flat head.
I guarantee your company’s provided tool is Copilot or OpenAI based, which is already bottom of the barrel for usefulness.
Haha, yes it is
Inuse a flathead (minus) screwdriver on a philips (plus) screw all the time
My experience is that it can work reasonabky well, but you have to waste absurd amount of tokens and have the 1m token context window.
I only do gamedev, which means a little bit more simple scriots, but it could handle even more involved systems.
If i force it to first document and explain the wholw architecture and data flow.
Did it help? Yes, but it still did take only a slightly faster. I could do it in a day more, probably.
It also cost like 50$ in tokens, in today’s prices - where every AI company is loosing trillions of money, so the costs will get a lot worse. And if I tried to conserve tokens, it’s shit. You have to feed it 10$ of data to be useful.
Add to that the fact that it also causes skill attrition, so once the expensive-cost future arrives, you probsbly won’t be able to afford it, and good luck getting your skills back after that.
Our company wants us to use it, and the average token consumption is like 100$ per day in consumer prices. How is that even considered for such a minor gain?
So, I’ll pass.
Especially once they kill the “old net” and you won’t be able to browse anything to learn skills at all.
kagi is the only way i can stay sane on web 3.0.
There’s enough people who drink the koolaid.
I helped this one as guy use an LLM to migrate his test suite to java21. It did help him incorporate some new language features but I don’t see how it made up for my time sitting with him
…… yet to management he saved 20% time. They trust that number despite no actual measurement, and hold it up as efficiency we all need to find.
But certainly if a 20% efficiency gain were real, that would be well worth $100
Id say you dont know how to use the tool. ‘Write tests here, develop.feature X’ is not a good way to use llms. Using 80k tokens and keep using same a Session is context rotting. There are a lot of boring, everyday tasks in my job that got faster. Many others that meh. Use AI, dont be driven by AI.
I think I’m going to use AI to tell me how to use AI.
I know this community is all about fuck AI, but this is just straight echo chambering.
But honestly your post sounds like you’re just not using it right? You can get pretty good results with it with enough guardrails. Just because you can’t get the results you want doesn’t mean that no one can.
That said, fuck AI. It’s all a bunch of bullshit, but denying real results just means you’re sticking your head in the sand and that’s not how you fix this problem.
I agree… Saying LLMs are good at nothing is just plain ignorance… One can disagree with the philosophy or dislike hallucinations, but they are definitely good at some things.
It’s basically like Google with a bit more detail in my experience. Everytime I’ve tried to use it in a professional context, I’ve come up massively empty. Pages and pages and pages and pages of just absolutely walls of text, but nothing actually useful. I mean I’ve got it to calculate stuff and whatever, but then you examine something and its not coming up for you like the LLM says it should be. Which pretty much immediately means you have to validate everything else, and then it’s like well hey look here I am however many hours later, manually doing something.
Our executives keep telling us to adapt or we’ll be on the losing end. At this point, I’d just like the check please. Because if the company can survive on images of Super Mario committing 9/11, or walls of useless text or just straight up make belief, that’s something I’d like to watch from the sidelines.
pretty good results with it with enough guardrails
examples?
For a research project, I had to convert 20+ projects from a dataset into a new format. The old format was simply a single script for each project that builds it. But I needed a format with a Docker file and a script. It would’ve taken me around a week to do all that one by one.
I got Claude to do it in 2 hours.
I know people hate AI in this community, but to say it doesn’t do anything good or to insult all people who use it is just pure negativity.
Thanks for sharing. I’m not sure where me asking for examples “say it doesn’t do anything good or to insult all people who use it”. Someone makes a claim without any proof, I ask for proof. To me that sounds both simple and legitimate.
Thats good. It has use cases. Is the monetary and earth destroying cost worth it? Not in the slightest
Or that it’s not right for their use case.
Like someone throwing a bunch of data into an LLM and trying to use it to process it into a chart or something. It can work, but it was never designed to be used in that manner.
I’ve got an acquaintance who does that, despite the fact that python would be a better thing to use.
Personally, I sometimes run a few saved images thorough a multi-modal 8 gigaparameter local model on my computer, so I can automate giving them more descriptive names than randomnumbers.png, and that seems to work fine. I could do it by hand, but it would take hours and days, compared to minutes, and since it’s not too important, it doesn’t matter if it’s wrong. The resource usage is also less of an issue, since it’s my own computer.
holy fucking shit man. this community has a clear astroturfing problem.
I don’t really know what the word means. I was posting my experiences.
not anything to do with your post. it’s the comments here.
fuckai used to be a community where no exceptions were made for AI. it’s quite literally in the name of the community.
so many posts from this community over the last 3-4 weeks has had an increasing amount of users that are “astroturfing” that AI has its uses and can be helpful sometimes. I kind of feel like these comments are made disingenuously as a way to silence the community at large by over commenting in a community that was created literally to hate AI, no exceptions.
anyway, won’t stop me from never using AI. If anything it’ll just make me read more books from before AI was a thing.
OHH I thought the opposite.
A lot of people have their livelihood tied to the narrative that LLM deserves every cent of investment. The fact that it’s utility is more limited is an existential threat to their careers.
The truth that it is selectively useful gives them a thread of hope, but the fact it is useless for a lot of stuff drives irritation. We don’t make a distinction between the sort of work that LLM can do and can’t so people end up completely dumbfounded by the other perspective.
I recently used it to install Nvidia l40s drivers on redhat 9 and pass it through to my Frigate instance. Took me a few minutes. Would have been a lot of reading to find the exact answers manually.
Not a bad usage
I also used it to compile the correct Yolo detection models since I wrote this comment. I gave it my specific cameras and settings and it told me how to compile the correct model. I have 200 cameras running now. Almost unheard of on a deployed Frigate instance. Using the correct cuda model now I’m seeing 38 percent usage average on my l40s compared to 80 before.
I cut my LLM usage to almost zero because of environmental and political reasons, but it was helpful enough to wish it could be sustainable and not another tool in the dystopian take on the world.
local models are advanced enough to the point where you can run em as needed without datacenter.
the datacenter craze is basically just an excuse to get the banks (and eventually the american taxpayer, via bailouts when they fail) to fund your local nepitistic infrastructure rollout.
the entire US economy is built around the purposeful boom/bust system, as it’s very effecient at “bagging” people that don’t know the rules.
They’ve still had a huge power investment in creating them.
An idiot intern is better.
Well, 100% because the intern WILL eventually learn. That’s the entire difference. It won’t be about adjusting the prompt, or add yet another layer of “reasoning”, or wait for the next “version” with a different code name an .1% larger dataset. No, you’ll point to the intern they did a mistake, try not calling them an idiot, explain WHY it’s wrong, optionally explain how to do it right, THEN the next time they’ll avoid it or fix it after.
That’s the entire point of having an intern : initially they suck BUT as you train them, they don’t! Meanwhile an LLM, despite technical jargon hijacked by the marketing department, they don’t “learn” (from machine learning) or train (from “training dataset”) or have “neurons” (from “artificial neural networks”) rather it’s just statistics on the next most probable world, sounding right with 0 “reasoning”.
Had a person a few years back who would never ever learn.
In fact, a way I have expressed my opinion of LLM is that it is like working with that useless guy, except at least faster.
Based on my experience, the broader company is chock full of the never learn developers and I suppose I can see why they see value in the LLM, but either way their product sucks and no one likes them.
You’re so right .
And if the person sucks that bad, get rid of them
Yeah, but the same bad management that keeps thinking LLMs are magic are the same bad management that kept that guy around.
Every interaction that guy had where a senior tech ever dared to say he was useless ultimately landed the senior tech in hot water with management, as they claim “he says you aren’t providing what he needs to suceed, that he is very skilled and willing to work, but you never told him how or gave him access or (a million other excuses that were generally lies)”.
After a way too long career with us, he finally overplayed his hand by making the same old claims to the manager about no one giving him what he needed to work. Except he forgot that this time, the manager himself was the one who had been directing him and so he accidentally was accusing the manager of lying to himself.
Finally, the only person with credibility to the manager was on the receiving end of this guys grift.
Its all a grift in the end!
Thats why youll mostly see conservatives/Nazis in love with llms. It fits their propaganda agenda perfectly.
For programming, at least it’s a good way to speed up things that you know how to do but take some time to type, or you don’t remember the syntax of. But relying on AI any more than that usually means you’ll be adding free technical debt and debugging time or becoming dependent on it.
