Tag Archives: plagiarism

No way to recognize AI generated text

Whatever I wrote before different methods to detect AI written text (using AI Text Classifer, GPTZero, Originality.AI…) seems now to be too optimistic. OpenAI even reports that AI detectors do not work at all

While some (including OpenAI) have released tools that purport to detect AI-generated content, none of these have proven to reliably distinguish between AI-generated and human-generated content.
Additionally, ChatGPT has no “knowledge” of what content could be AI-generated. It will sometimes make up responses to questions like “did you write this [essay]?” or “could this have been written by AI?” These responses are random and have no basis in fact.

When we at OpenAI tried to train an AI-generated content detector, we found that it labeled human-written text like Shakespeare and the Declaration of Independence as AI-generated.

Even if these tools could accurately identify AI-generated content (which they cannot yet), students can make small edits to evade detection.

BUT – according to a recent Copyleaks study, use of AI runs at high risk of plagiarizing earlier text that has been used to train the AI model. So it will be dangerous for everybody who is trying to cheat.

https://copyleaks.com/blog/copyleaks-ai-plagiarism-analysis-report

Open peer review – publish first, review later

c’t 10.2008:82-89 has a nice article about open peer review “Die Weisheit der Massen” summarizing the current peer review process – the top line of the cartoon below. Following submission of a paper, it is initially screened for some formal requirements before being submitted to anonymous peer review and finally being published. Anonymous peer review lasts between 2 months and 2 years (!) and is abbreviated so far only by one biomedical journal Continue reading Open peer review – publish first, review later