Viewing a single comment thread. View all comments

smswigart OP t1_j7daxj8 wrote

Reply to comment by the_zelectro in The Future of AI Detection is Bleak by smswigart

I think they're trying to make it general purpose so that it can detect ChatGPT output, and outputs from other generative AI, but yeah, detecting its own output should be a no-brainer.

Also, if something existed before 2021 and is in its training data (like bible verses), it should also be certain that it wasn't AI generated.

5

Veleric t1_j7e5c77 wrote

I've said it before, but it makes zero sense for these systems to be 100% accurate with whether it's AI generated because it strongly disincentivizes anyone from using it. Creators don't want to be called out on it for being lazy. Researchers don't want to be called out for plagiarism. Students don't want to be called out for cheating. Copywriters... And on and on. It only hurts them and by introducing any tools to try to identify them leads to witch hunts and false accusations that could ruin livelihoods. It's going to be a bit of a mess trying to validate that students for instance actually learn the material, but if they validate the information as factual and use some thought and revision in prompt engineering to generate quality output, that seems to be a very valuable new skill heading into a very different world than just 6 months ago...

1

RaccoonProcedureCall t1_j7f71qa wrote

I disagree that learning to use ChatGPT should replace learning other skills for students, but your point about there being an incentive for OpenAI to make a bad detector is a good one that I hadn’t considered before.

I guess expecting OpenAI to make a good detector is a bit like expecting a site that allows students to pay for homework answers to include a service to help teachers identify answers taken from the site. Any site that would try such a thing would quickly become unpopular with students looking to cheat, and they’d take their business elsewhere.

5

Veleric t1_j7fih6c wrote

The key for learning in particular is not so much the material itself (with some exceptions) but rather the process of attaining information, processing it in a thoughtful and discerning manner, and disseminating it in a concise and digestible way. Going forward, the average person will need to retain less and less information, and while you can decide whether you think that is a good or bad thing, the ability to find what you need quickly is going to be what's most important.

1

NofksgivnabtLIFE t1_j7fmdkp wrote

This is what the internet was meant to be before corperate took over. Its all going to wildly ok.

0