PhoneAcc2
PhoneAcc2 t1_j6qvw8j wrote
Reply to comment by 9-11GaveMe5G in OpenAI releases tool to detect AI-generated text, including from ChatGPT by whitecastle92
The article misrepresents this.
They use 5 Categories from very unlikely AI generated to very likely.
26% refers to the AI generated part of their validation set being labeled as very likely AI generated.
PhoneAcc2 t1_j6recky wrote
Reply to comment by IKetoth in OpenAI releases tool to detect AI-generated text, including from ChatGPT by whitecastle92
The article suggests there is a single "success" metric in OpenAIs publication, which there is not and deliberately so.
Labeling text as AI generated will always be fuzzy (active watermarking aside) and become even harder as models improve and get bigger. There is simply an area where human and AI written texts overlap.
Have a look at the FAQ on their page if you're interested in the details: https://platform.openai.com/ai-text-classifier