Yeah, you should have checked it before you ruined all those poor students' lives.
this post was submitted on 27 Jul 2023
120 points (97.6% liked)
Technology
59207 readers
2896 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
Also disproportionately inflicting false positives on neurodivergent students.
If I was a student who wrote a text that was rejected due to this tool, do I have a case against either my institution, the professor who threw it out or OpenAI?
I am stuck with defamation but idk if that's actually defamatory in itself, as that only works if the professor or school had done due diligence that the tool is good for use, but there were already reports that it was not.
do I have a case against either my institution, the professor who threw it out or OpenAI?
This all seems like such recent technology, I can not imagine this question being very answerable except via the long way: a courtroom. I suspect it would take someone trying in order to set precedent.
Turnitin isn’t AI technology but I assume it has similar legal ramifications and a lot of schools require teachers to have everything go through turnitin (usually by having students submit online). It just spits out a percentage so that the prof can take a closer look. Real quotes count towards the percentage displayed. Maybe with AI you’d have a bit more of a case against the company because you might claim you trusted it to be accurate or something?
Real quotes count towards the percentage displayed.
TII can be configured to ignore properly quoted texts.
There's a similar issue in chess with cheating detection. They use statistical analysis to see if someone's moves are too good. Computers play at a much higher level than humans and you can measure how "accurate" a move is.
It doesn't mean much for a few moves or even 1 or 2 games but with more data you get more confidence that someone is cheating or not cheating.
Chess.com released a rather infamous report last year about a high profile chess player that was cheating on their site. They never directly said "he is cheating" but simply stated "his games triggered our anti-cheating algorithms"
One is debatable, the other is a simple fact. The truth is an absolute defense to defamation. Hans attempted to sue Chess.com for defamation and from what I understand, the case got recently dismissed.
I'd imagine these AI detectors for schools have similar wordings to avoid legal risk. "High probability for AI" instead of saying "AI written". In that case, you may have very little case for defamation.
However, I'm not a lawyer. I'm just guessing these companies that offer this analysis to colleges have lawyers and have spent time shielding the company from legal liability.
AI writing detectors are so shit. One of my written assignments was flagged as being written by AI even though at the time of writting it, programs like ChatGPT was not even popular or mainstream.
Yep, I think there should be a revolution in regarding how teachers structure their assignment for their students. AI is here to stay, and the education system needs to find a way to coexist with AI. In order to survive, education system need to find a way to make AI usage like calculator usage when working with math problems.
Expect when you got teachers "Memorize all the formulas as it'll be on the test." and they don't provide the formulas even though in the real world, they just fucking look it up.
There is a reason for doing it that way.
I remember complaining to my dad about this exact thing saying that people just look it up in real life. He told me that in the end, the grade that I get will only tell future employers that I am more or less "teachable" compared to others.
What you studied, specifically, didn't matter. It's how well you learned the material in a short period of time, then cranked out correct answers in a time-pressure situation.
If you can do that quickly, you get a better grade, which tells people that you are a better candidate for a position.
Because all LLM outputs read like middle school homework essays regardless of context
If I started an AI chat bot that was capable of sounding human, why wouldn't I make a crappy AI writing detection tool and then shut it down shortly afterward saying "my AI chat bot is too good! You can't detect it!"
Don't forget wanting to introduce regulations for AI because it's "dangerous", but no not mine, mine is the good one.
Usually you check this sort of thing before releasing it...
And once you release the LLM detector it becomes a training tool for LLMs and those creating them to fool the detector.
It is like the battle between google search and SEO tactics, except at hyperspeed.
I have only heard about this tools, but never used one for myself... Are there any other tools like this?
None that work from my understanding at least.
Some work ok-ish on long texts, but none are reliable enough to not produce false positives. Might be worth using it as one bit of evidence amongst others for stuff where it really matters, like some master/PhD thesis, but definitely not for Jimmies 8th grade essay about Lincoln.
Lol well that’s moderately terrifying
And an entire generation of students breathed a sigh of relief...
They shouldn't, their profs are now going to use whatever random crappy website comes up first when they google "AI detector."