this post was submitted on 28 Jul 2023
463 points (93.6% liked)
Technology
59593 readers
2888 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Being detectable does not mean plagiarism. The way they did it was by using a fixed rule for generating high entropy words. These are words that can be replaced with a large number of different words without changing the meaning of the sentence. Given any original passage of text, it's very unlikely for those words to all exactly follow the rule set by the generator, but a generated text will always have this rule followed, so they can be distinguished. Likewise, You can take any original passage and replace words in this fashion to increase the odds of it being detected as AI generated and the resulting text will still be original text.
Here's the thing though - the probabilities for word choice come from the data the model was trained on. While someone that uses a substantially different writing style / word choice than the LLM could easily be identified as being not from the LLM, someone with a similar writing style might be indistinguishable from the LLM.
Or, to oversimplify: given that Reddit was a large portion of the input data for ChatGPT, all you need to do is write like a Redditor to sound like ChatGPT.
I think you're trying to handwave at someone who knows more about the steganographic watermarking approach than you do.
AI content isn’t watermarked, or detection would be trivial. What he’s talking about is that certain words have a certain probability of appearing after certain other words in a certain context. While there is some randomness to the output, certain words or phrases are unlikely to appear because the data the model was based on didn’t use them.
All I’m saying is that the more a writer’s writing style and word choice are similar to the data set, the more likely their original content would be flagged as AI generated.