• 0 Posts
  • 7 Comments
Joined 5 months ago
cake
Cake day: August 31st, 2025

help-circle

  • In a randomized controlled trial, we examined 1) how quickly software developers picked up a new skill (in this case, a Python library) with and without AI assistance; and 2) whether using AI made them less likely to understand the code they’d just written.

    We found that using AI assistance led to a statistically significant decrease in mastery. On a quiz that covered concepts they’d used just a few minutes before, participants in the AI group scored 17% lower than those who coded by hand, or the equivalent of nearly two letter grades. Using AI sped up the task slightly, but this didn’t reach the threshold of statistical significance.

    Who designed this study? I assume it wasn’t a software engineer, because this doesn’t reflect real world “coding skills”. This is just a programming-flavored memory test. Obviously, the people who coded by hand remembered more about the library in the same way students who take notes by hand as opposed to typing tend to remember more.

    A proper study would need to evaluate critical thinking and problem solving skills using real world software engineering tasks. Maybe find some already-solved, but obscure bug in an open source project and have them try to solve it in a controlled environment (so they don’t just find the existing solution already).




  • I wasn’t really trying to give my opinion, but since you asked…

    I think copyright laws are a good thing for everyone. They’re definitely not perfect, but they do much more good than harm. The problem (which is not unique to copyright) is that the legal system treats large corporations differently than individuals and small businesses. The recent AI hype wave has supercharged this problem, but it’s not new.

    there is actually something inherently wrong with reusing code?

    Depends on what you mean. Open source software usually comes with a license attached, which is effectively a permission slip from its creator telling you what you can or can’t do with it. Without that pernission, you’d be violating their rights under copyright laws unless you limit yourself to what counts as “fair use”. That’s perfectly fine, and I don’t see why anyone reasonable would take issue with that.

    I know there are some fringe people out there who think copyright law shouldn’t exist at all, and that no individual deserves the right to exclusively profit off of their creative works. I don’t agree with that, and I don’t see how open source would work in that scenario as nobody would want to release anything. It’d make exploitation of the poor by the wealthy even more extreme, as those with the means to mass produce derivative products (eg you own a factory that can produce paintings or whatever) would be the only ones making a living off intellectual properties.

    But this is getting way off topic. I just wanted to call that guy stupid.


  • This is a dumb take. You didn’t understand the assignment.

    “From scratch” in software engineering usually means it was written without a starting point, being based off an existing implementation. It doesn’t mean it was written by someone who indepdently discovered computer science and software engineering on their own.

    You’re trying to regurgitate a pro-AI argument you read somewhere that defends OpenAI and others’ use of open source software to train their commercial models without paying, following open source licensing requirements, or even providing acknowledgement of their source (typically called “copyright infringement” or “plagiarism” when-non-billionaires do it). The argument you are plagiarising here tries to conflate human learning with AI training, which is as stupid as me saying that downloading movies for free is legal because I’m “training” my brain on that content.

    If you like AI slop, that’s cool. Idgaf. But if you’re going to wade into the controversies and politics though, maybe think a little harder before making a fool of yourself? The people you’re trying to argue with likely haven’t had their brain and critical thinking skills turned to mush by using LLMs as much as you have.