Students are relying on AI so heavily that universities are being forced to fundamentally rethink how they grade their work.
England’s higher education regulator, the Office for Students, is warning universities that they may need to replace traditional take-home essays and open-book exams with supervised assessments that prevent students from relying on artificial intelligence to do their work.
AI-detection tools are too unreliable to consistently determine whether students have used the technology, the OfS said in a report published Wednesday.
Just make finals and exams oral, like interviews.
I like the idea of an oral exam. You come prepared to present a topic and answer questions. You are allowed to reference your notes, cards, etc. on the fly.
My professional qualifications all had an oral exam board. Was some of the most nerve wracking things I ever had to stand/sit through.
My masters in classics had your full class grade based on a colloquium. I really enjoyed them, we were a cohort and got to see each others’ projects.
For me it’s insane that they were allowed to take the test at home in the first place. Trusting in honor isn’t ever going to work.
Even five years ago, these were fine. You couldn’t cheat if you didn’t know the material.
In the pre-AI age, I think take home tests were fine. However they were generally much harder than a similar in person exam on the same material. I remember one professor gave the advice “if you are given the option between a take home exam and an in person classroom exam, always take the latter. Since the former doesn’t have as tight of a time limit as the latter does, and will almost always be far more challenging” (or something to that effect)
That guy didn’t see my heat transfer final during junior year. Some of the other students were crying at how bad it was
Lol, that doesn’t mean that in person exams will be easy. This was my linear algebra professor, who had very difficult in person exams.
Especially when you can offload to AI like a jock offloading on a nerd. No papers, oral… in person shit.
Take home tests? I didn’t read that in the article, take home essays yes. Which is just normal homework
I’m from before the era of take-home tests. We still had homework though which is still an awful way to do things, so maybe AI will motivate the educators to do something better.
I mentioned this in another post, maybe in a few.
The college I’m going to requires you to now use a Microslop account instead of a student one; this isn’t new but it sure was confusing when you have three different emails for the school.
So when you log in. You’re greeted by ChatGPT. The website for the school is such a clusterfuck that their website search uses AI. Then your writing is checked by AI. Now they encourage you to use an AI website for MLA/APA citation. Also your work is probably being graded by AI since most of the time it takes forever to get an answer from whoever is teaching the class. The amount of scripts seem to point that your mouse movements and keyboard strokes are being checked by AI since using RespondASS(the show us your room and you’ll get flagged for looking at your keyboard and more! Like we might accidentally brick your computer!) was so very welcomed(sarcasm).
So there’s a point where you start to think about whats really going on when you’re rammed up the ass with AI shit and the syllabus says you can’t use AI and assignments say “write it in your own words.”
It’s interesting. I wouldn’t doubt that all the written papers are being used for llm training. Then you write your paper in your own words, and get a lowered grade because you made a jokey joke. If your friend has an issue in Windows 8.1 and came to you for help, what would you do? Find a new friend. I answered whatever the question.
Nothing too serious, and you ask why the lower grade. It wasn’t professional and this class is being monitored. I answered the question and to top it off there were two-three other people that copied and rehashed my answer…
What I wrote was correct as I had done it, I just wrote it in a anti-AI way that someone had to read it and understand the concept.
So in conclusion, college is fucked. Half of it is advertising software and the other half is wasting your time. I’ve had good teachers and then I’ve had more idiots that don’t belong teaching, well they don’t if it takes almost a week to get an answer.
I can also confirm that functionality in Microsoft products is (I think deliberately) being dumbed down and made counterintuitive in order to force people to use CoPilot. This has been especially problematic with Sharepoint.
It’s very likely deliberate. Even the operating system. I booted an old computer up with W7 and I was surprised how much easier it is to use.
One class I had, they do a VM style “sim” and you’re asked to open the terminal. Okay I press win+r to type in cmd. Incorrect! Use the search bar and type in terminal… I was pissed off
I don’t why so much of it is dependent on writing a long paper and having several people read through it. It’s a waste of time even before AI.
Just do a quick 10 minute oral exam and you’ll know if they understand it.
Some things take more than 10 minutes to explain, but only if you need to start from scratch, so for more advanced topics they should just ask questions from the top down and assume the basics. Anyone who fails to understand the basics will obviously fail the deeper meaning as well, or shouldn’t have been able to come to that level of exam anyway.
The point of an essay is that a person may, accurately and succinctly, convey a complex idea to a stranger across an ocean using only the written word. Which is half the point of literacy. Where I to hire a college grad who couldn’t compose an email about a complex, nuanced subject, i would think real hard about hiring any alums of theirs.
Knowing stuff isn’t enough. You have to be able to present it in a communicable fashion.
Nobody reads college student essays over the ocean.
Anyway, you misspelled “were” and forgot to capitalize “I”. I will forgive your comma mistakes, because I am not in a position to correct commas in English.
C-.
Lol. Missed the point
If you can’t articulate why schools use long essays, perhaps you shouldn’t suggest scrapping them. One should know how a machine works before one starts tinkering with it. And a course is a machine like any other. Don’t start pulling out pieces before you know what they do.
If you don’t how a system works, it’s the perfect time to disassemble it.
Why is that?
You’ll learn from it. (which is the purpose of universities, rather than grades or papers anyway)
In this case though, it’s more because the system clearly doesn’t work, so something has to be done eiher way.
They (schools) can’t fight AI forever. It will over burden them with slop no matter what they try. It’s futile to think that it can be detected, f.i. if the students put the AI in speech mode and writes down the answers in hand etc.
It’s better to rethink the entire purpose of what they’re trying to achieve. Hundreds of pages of written paper probably isn’t it to begin with.
They’re trying to educate: To get knowledge into the head of students. A written paper won’t really show what’s inside the head of the student regardless of it being written by the student, their parents, Indian fiver hirees, AI or simply paid to pass.
IMO the validition process has to be rethought, and it’s only good that AI has broken the system.
I agree that something has to be updated. Breaking it down is a good way to Understanding what you’re breaking down helps understand why and how to improve it. Especially something as complicated as an entire education system and the resulting tech relationship. On some level I agree, something needs overhauled. But it’s also impossible to anticipate future technological leaps that would do something like this again. We as a people need to be more measured in embracing tech so wholeheartedly. I don’t know that there is a blanket response to such things that every individual school can address. This is something national leadership should be addressing. The whole scale blind adoption of ‘AI’ is the cause, it’ll take more than college boards to address
This is the way
I’m all for that, but some people will complain that they get nervous and that’s why they couldn’t state how they do the things.
The amount of accomodations in US colleges is insane to where some people are allowed to take extra time, or take their tests not in a classroom setting, or have their tests read to them because they’re illiterate or a variety of other things that just aren’t compatible with the workforce is insane.
Seems insane to not assist people learning. Reaching people you otherwise would not is a good thing.You WANT more people in the work force who can understand concepts. Who gives a shit how they demonstrate it or if they need an accommodation?
Supporting people through their weakness can help them find or reinforce their Strengths. That is absolutely something education should strive for.
The accommodations are other life skills that they are lacking in. I think oral examinations would really highlight weak points for a lot of people and they would seek exemptions that are easier.
I’m not saying that you don’t assist people with learning, but I think testing and learning are two different beasts. I think having a uniform standard for testing is a good thing, I’m all for oral examinations or proctored written tests, but I worry about all of the people that will seek exemptions from it because they can’t perform to the same standards on those tasks. It’s degrading to the letter grade of everyone else.
I do think that it is the responsibility of every student to study and find resources that best fit their learning style.
and they’re jot going to adapt. they’re just going to pass idiots.
Pen and paper. Let’s not think too hard here. The answer is simple.
I wish it was that simple, I really do, but when did handwriting get dropped from the curriculum? Ok slightly hyperbolic, that was the US, still on the UK curriculum. But the importance of it has dropped dramatically.
Even 10 years ago the legibility of student answers was sufficiently awful we were doing exam technique training for students and it has degraded substantially since then.
Hi! Nerdy uni student here, it’s an 80 people classroom. People just sit in the back and use their phone during paper exams. They then go to class groupchat to boast about how clever they were for coming up with that idea…
Also since professor has actual research to do, exams are proctored by the teaching assistants who frankly don’t care. In fact TA’s openly use AI to grade homeworks.
May sound slightly biased, but I think the solution is people going “exams were not meant to be part of this system, or at least in the current state they are” and making some reforms.
Faraday cage on the room. Your phone is now a glorified calculator.
kid thinks he’s smart and puts a local model on their phone
The model is dumb as shit
Kid fails
Have you ever proctored an exam before?
There’s the right answer, and then there’s the practical answer. This is the former.
They’ll just use AI then copy it to paper.
That’s not how that would work at all, because they wouldn’t have their phones. They would have pen, paper, and a desk. Where’s the AI coming from?
You are aware that teachers still preside over the classroom correct?
You are aware that this article is about take home work for college, right?
It’s only about take home work in the sense that it’s advocating against it
England’s higher education regulator, the Office for Students, is warning universities that they may need to replace traditional take-home essays and open-book exams with supervised assessments that prevent students from relying on artificial intelligence to do their work.
Then pen and paper aren’t necessary to prevent AI use. Its trivial for IT security to pull logs of students suspected of using AI to cheat (it’s part of my job), or to block AI at the firewall level.
Are you implying that mobile networks do not function on university campuses?
Why would that matter if they’re taking the exams and writing essays in the same room as the professor?
Just like they gave up on all previous forms of cheating. Anyone clamoring that degrees will be useless NOW has not been paying attention. Until universities are held accountable for unleashing incompetent cheaters onto society, the financial incentive is to throughput as many students as possible and it has been for a long time.
And it’s not just financial incentives. Many institutions are difficult to get into. They have a process and hold that process, their judgement, in high regards. If someone gets in and is a failure that reflects poorly on them. They want students to succeed, one way or another, to show what brilliant students they attract.
Please, they never even tried for the most part, they just wanted some easy bullshit tool where they could click a button and not worry about it. This bullshit predates AI by the way, companies like TurnItIn should be sued for fraud because people who actually wrote stuff have been falsely accused and people who plagiarized shit went undetected. These bullshit software packages never really did what they claimed to be able to do.
You want to actually stop AI cheating? Easy: In person tests and essays where the teacher is actually paying attention; no computers, phones, or other smart devices. Problem solved, you’re welcome. Yes “professor” that means you have to do your fucking job instead of clicking buttons in Learn or Canvas or whatever dumpster fire on an LMS you’re “teaching” on. Cry more I guess? People are paying a shitload of money for this, take it seriously, asshole.
Sorry, I’ve had some shitty professors.
Okay, but here’s the situation at the institution where someone I know teaches…
Students enroll with Disability Services (roughly 1/3 of the class) because they tell their doctor they have test anxiety. Doctor then gives them a notes saying “so-and-so has test anxiety”. Nevermind the fact that anxiety around a test should be a normal reaction – particularly tests you never prepared for.
They get presented with a buffet of options for what will help them “succeed”. And THE STUDENT picks what they want. Triple time to complete their tests? Unlimited unsupervised bathroom breaks? Flexible scheduling (i.e. taking the test after everyone else got their results back & knows the answers)? Private testing rooms with no proctor? Ability to use AI “just for grammar”? It’s all there…
Absolute raging trashfire…
Blaming neurodivergent people for this is a chickenshit move TBF.
Another avenue is doing regular screenings, orally or hand-written. Any sus answers, that student gets flagged and further evaluated.
But, the problem is, as I’m sure the article I haven’t read points out, that cost-benefit is all fucked up. The benefit to students is they get a degree without having to do any work, so lots of people are going to do it, and the cost to Universities would be having to expel a good chunk of their students, which is going to cost them a lot of tuition money and alumni donations.
The reality is that the value of a university education–outside of STEM–in this bloated labor market is really just a social credit. What we need to tackle is all the poeple who can’t get hired for positions they are absolutely qualified for but can’t get because they don’t have a degree.
There is something called a BONAFIDE QUALIFICATION written into employment law, and “college education” is considred a bonafide qualification even if it’s not.
A real education is very important in many ways, some of which are harder to quantify. Instead of pushing people through these bullshit conveyor belts in what is sometimes little more than glorified daycare for adult children, we should actually fix education. Instead, it’s under attack by fascists all over the planet because an educated populace is not as easily controlled.
Yes, there’s education and then there’s degrees. In my experience, anybody is capble fo getting a degree, but education is optional and largely up to the student. The only degrees that demand an actual ability to think and research and formulate are PhDs.
I find colleges and universities are, at this point, largely extractive, dumping people into adulthood with massive debts and no employable skills and I am through supporting them in any way. That doesn’t mean I don’t value an education or the ability to think critically, I’m just using my ability to think critically to realize that much of higher education is a scam, and the role of a degree is socially determined.
The student is only part of the equation: If they were never given the tools to learn to begin with, that’s on society more than it is the student. I do agree though: One can obtain a degree without actually having received an education.
I think most people just don’t engage analytically no matter what tools you give them. My sister & I went to the same exact schools and she ended up a homeschooling anti-vaxer.
I think even many people who are willfully ignorant can be reached, but things have to kind of line up for it to work. The odds of that happening in an educational system that has been gutted are much lower, which is probably what the assholes doing the gutting are counting on.
It seems like the quality and nature of the education system is impacted by the economic system in which it exists
I don’t understand why they ever stopped to grade with supervised assessment. Before AI they could get someone else to do the work for them. I don’t get it. It’s such an obvious and simple solution to AI cheating.
I did exams for Java and C++ with a pen and a paper. No books, laptops were too expensive, and no one was using this new wifi thing. It should be easy: a sheet of paper and a pen.
Uuugh… I hated having to write Java and C++ for tests and quizzes. That fucking sucked. Fortunately, that was only a problem during our first year. Starting our sophomore year, we submitted code projects to the server. No more having to write that shit down.
There was still writing down lots of code in our notes during lectures, though.
I once had to do two entire semesters on coding in RPG IV with only pencil and paper. We only got actual access to the school’s AS/400 server after, during the third semester. Kids and their AI slop these days… pfft
I stopped taking coding classes because we had to handwrite code and syntax was part of it. I’d be getting 60% on tests not because the code was wrong, but because I forgot to put a semicolon at the end of every line. Something that notepad++ did for me.
Actually, programming classes flipped my normal grade situation. Normally, I’d get 0% on homework (never did it) and 100% on tests, for a B/C average. My coding classes I’d get 100% on homework (I actually enjoyed it) and 60-70% on tests.
Sounds like you had trouble learning the importance of semicolons for separating statements.
I mean. Not really? I understand the need for proper sytax in separating statements, I just hate memorizing shit. That’s why I usually code with documentation open to check my syntax, and often rely on stuff like notepad++ to handle basic syntax for me. That way I can focus on doing the thing I want to accomplish, as opposed to spending time on glorified spell check.
That being said, I’m a chemical engineer, not a software engineer. I’m sure it becomes second nature given enough time.
I think the thing that annoyed me the most is that if you forgot proper syntax, you’d just lose points. In comparison, if I was taking a physics test and forgot an important formula, I could derive the formula I needed from basic principles relatively easily. No such luck with syntax. You either know it or you don’t.
Yeah, that’s part of the challenge of languages in general. I agree that physics is easier - I, too, would just re-derive forgotten formulas from first principles. But ad least language syntax shares commonalities, and is far less reliant on rote memorization than the bullshit that is biology.
Oh fuck bio.
And I agree with languages. I speak three, and that definitely came from use more than memorization and learning. First two came from cultural immersion, but I took German classes. I still learned German by switching all my videogames to German though, and playing mmos on German servers for “cultural immersion”. Not the classes.
I’m sure that the purpose of taking points off for syntax failure was my professor’s attempt to do something akin to cultural immersion for programming, but the end result was that I continually lost points on tests for reasons I considered dumb. I picked up more syntax from programming RuneScape bots back in the day than from classes, analogous to how I learned German. I’m sure more advanced classes would have focused more on the theory of programming and logic, but I just didn’t get there. It’s kind of like losing points for bad grammar on a language test.
I guess the classes just didn’t work for how I preferred to learn.
Well, you should lose point for bad grammar on a language test. And the best way to learn just about anything, but especially programming, is to do it! Make more bots.
Because classes swelled while faculty did not.
Their paychecks swelled though, right?
…right?
Oh, no…
This is UK, universities are chronically underfunded by government. They did this just to keep the lights on.
I am from the US where universities are also chronically underfunded by the government (an uneducated populace is easier to manipulate), but still pisses me off.
People who cheat are always going to find a way, but there’s still value in making it less convenient. If nothing else, a person has to learn more about real-world maneuvering if forced to get creative with it.
where I live, supervised exams are still the norm, but if you bother lookibg arround during the test you will quickly notice thwt pretty mcuh everyone is still cheating
Cheating how? If the exams are not silly copy pasting of raw knowledge and actual require to use intelligence to create a solution (as they should at this level), only having some hidden notes will not help much and this is not a big issue. It is still much better than delegating the thinking to an AI.
That wasn’t my experience.
Exams at my university were supervised not just by the professor but all of his TA’s, who kind of patrolled the room. It would be very hard to cheat without someone noticing.
And I’m glad for it. Cheating should require creativity and effort.
The wealthy can afford to have someone else do their work, and you wonder why the institution didn’t put a stop to it?
i went to a college that had no homework, but lots of recommend reading/exercises, all grading was tests and exams in class on paper. AI would have no use there
Welcome to 2024?
We ditched all digital testing and went back to paper exams. There are two med school classes full of AI cheaters and we’ve had record numbers of med students and grad students kicked out of programs. Fake it until you make it doesn’t actually work.
Interesting concept: attempting to detect AI use in drafting academic assignment solutions, when the AI itself is trained on works published by the academically trained…
Unpopular opinion:
Who cares if they use AI? When I was in college I’d do other people’s homework for beer money. I got smarter, they didn’t, I got beer. Worked out fine for me. People who paid me to do their work for them…well, either they ended up redoing it themselves, or they failed out and found something else to do that better fit their interests. Honestly, kind of a win-win
Who cares if they use AI?
Because they are applying to competitive professional programs, with limited entry numbers, so for every cheat would gets in, one person working 90 hour weeks is excluded. Onto grad school and med school, those programs require physical expertise and knowledge at the experimental bench or ER.
You really want a doctor who cheated his way into med school treating you in the ER while you’re bleeding out?
This is a huge problem already and frankly, post-secondary cheating should be a criminal offence.
Yeah, assuming they can pass the entrance exams. Can’t really have AI take your MCAT for you.
On the other hand, if someone can cheat their way through intro courses and still submit a competitive application with competitive test scores? They’re smart enough to get it done.
Those people who I’d do homework for? They usually started failing pretty hard around junior/senior level courses. That’s the problem with outsourcing your thinking. Most every professor knows what’s up when someone is submitting 100% homework assignments and getting 50-60% when exams roll around.
deleted by creator
How come no one in all the governments is thinking “we are destroying society and we will be fucked in 10 years”? I mean, it’s pretty obvious. I’m not a conspiratard but it feels like people in power want others to be really stupid.
Because you don’t get into positions of power with that mindset. You get into position of power with the mindset of “how can I look good today?”
Always has been.
