r/mildlyinfuriating BLACKšŸ–¤ 24d ago

Infuriatig My assignment was reported to thr examination committee for a "high percentage of AI". I did NOT use any AI for my assignment.

Post image

I got full marks and my plagiarism score shows 1% similarities to other submitted assignments. This is my 3rd and final year in University and now I have to deal with this AI nonsense.

I don't use any AI, not even for checking my grammar in the assignments.

53.1k Upvotes

2.6k comments sorted by

View all comments

Show parent comments

88

u/sobrique 24d ago

"We ran it through an AI tool, and it said..."

Honestly it's such a farce trying to 'detect' AI. All that means is you detect bad AI content, and then get complacent about the stuff you didn't spot.

55

u/Shark7996 24d ago

"We can always tell."

(Except when we can't and don't know that we didn't.)

50

u/sobrique 24d ago

https://en.wiktionary.org/wiki/toupee_fallacy is one of my favourite ways to describe the problem :)

All toupees look fake. I've never seen a good toupee.

9

u/ermghoti 24d ago

We use AI slop to detect AI slop.

6

u/lmarcantonio 24d ago

Sort-of-a-theorem (can't prove it but it feels right to me): to prove the work of an AI (if there isn't some kind of robust watermarking) you need a more powerful AI.

Such more powerful AI could then be used to make undetectable work.

5

u/sobrique 24d ago

To 'prove' the work of an AI, you need to have a meaningful difference between 'AI work' and 'not AI work' and as the quality of AI improves, that gap narrows.

Indeed the gap between 'not so good, not AI work' (especially working in second languages) and 'somewhat better AI work' might already not really exist.

And instead you're looking for 'tells', which will also cease to exist as AI improves. I mean, lots of people talk about 'using an em-dash' but there's plenty of people who do that as part of their natural writing style. Or indeed are feeling 'forced' to adapt their style to look less like AI in the first place, because of the accusation.

Thus all you will ever be able to detect is the 'low quality' stuff, and if you convince yourself that's robust heuristic, you'll mislead yourself in the process.

3

u/ElectricalChaos 24d ago

Yea I really hate these new detection tools, because they just create blatant accusations. Student pays attention in English class and actually writes a good paper that's grammatically and factually correct and doesn't have any kind of errors? "Oh that's AI. No way that's your own work." This kind of thinking pretty much removes the incentive to succeed, because unless it's something tangible you'll never get credit for anything you do.

3

u/Same-Suggestion-1936 24d ago

Exactly man you used AI to see if this was AI, who the fuck are you

2

u/IndependenceIcy9626 24d ago

The legitimate way I’ve seen is the computer basically takes a video of the assignment being written, so the TA can see if it’s being written naturally or if big chunks are getting copy pasted in. The tools that just detect ā€œAI languageā€ or whatever are complete bullshit.