Viewing a single comment thread. View all comments

SerialChilIer t1_j0uynq1 wrote

I really don’t know how schools and universities will combat this technology. ChatGPT is already able to make various forms of prompts you input, not just one. And this technology is still very new, imagine how good it will be in 5-10 years.

Schools are going to have to adapt how they handle certain assignments. I have no clue how.

138

foxhelp t1_j0veq0f wrote

Apparently chatgtp isn't very original when you give it the similar essay prompts, so the high school principal I talked to said you basically just go plug it in and see what it generates and compare the output.

Add on differences in grammar, word choice, perfect spelling and it becomes pretty obvious something doesn't align within the same semester. I guess the problem starts arising when the student uses chatgtp for all their submissions in a new semester the differences aren't as obvious.

There is also services that are springing up to determine if an essay is machine generated.

46

EstablishmentShoddy1 t1_j0vnt8l wrote

fair but you can still paraphrase chatgpt and your fine. Half the time essays are hard to due to writer’s block

17

andrenikous t1_j0vtefw wrote

"Just make sure you change some of the words and move stuff around so it doesn't look like you copied me."

21

gender_nihilism t1_j0vtn6n wrote

then you're just using a tool. honestly, what's the problem? if you review it, edit it, and expand on it while verifying it, you've saved yourself a lot of grunt work while still doing everything actually important: the actual thinking. I use it for scenes in stories I write. I take the output, rewrite it as if I were editing my own writing, et voilà, free writer's block clearance.

15

checker280 t1_j0vykkv wrote

It was always less how much you remembered and recalled, and more knowing where to look for the info and what info to look for.

10

foxhelp t1_j0w1czd wrote

Curious as a writer what you thought about the guy that made the kids book using AI?

https://www.buzzfeednews.com/article/chrisstokelwalker/tech-worker-ai-childrens-book-angers-illustrators

3

gender_nihilism t1_j0w89fu wrote

not the same. using an ai image generator is different because you're not deriving your work from the output, but rather just publishing the output. I'm not making a judgement here, except that they're emphatically not the same thing.

8

abraxasisall t1_j0vubxc wrote

This is going to be what I find impossible to prevent; paraphrasing it and rewriting it slightly in your own words. I suppose one way to check it would be to have another program input a bunch of prompts and compare the original essay for likeness, in the same way that there are programs already that scour scholarly works on the web and compare for likeness; except this time it’s testing AI outputs.

Now if only it could write mathematical proofs for me..

Edit: it can fucking write proofs

5

EstablishmentShoddy1 t1_j0w2cen wrote

Yeah I heard the AI isn't really sophisticated for math

3

abraxasisall t1_j1180fo wrote

They’re wrong, it can write proofs perfectly. I think it has limited characters (ASCII) available to express certain concepts however; if it could freely use laTex I think it would be able to accomplish exactly what we’re discussing.

I asked it to prove all kinds of math problems ranging from simple (using mathematical induction, direct proof, contradiction to prove things) to complex (prove certain functions f: Z -> Z are injective, surjective, or bijective (both), prove that the cardinality of Z, set of all integers, is less than R, set of all real numbers) and in the cases I tried, the proofs were sufficient. Remarkable.

2

ApatheticWithoutTheA t1_j0vuvuz wrote

It’s very dependent on how much you interact with it.

If two people give it a similar prompt, yeah, you’ll probably get a similar answer. But the more you talk to it and it direct it, it can become very tough to tell.

You can even paste in another paper you have written and have it copy your writing style.

15

foxhelp t1_j0w136n wrote

Which I think is a distinction of "very low effort cheaters" getting caught verses the "moderate effort cheaters"

14

adrolter t1_j0x92pj wrote

Still miles easier than actually doing the assignment, and will only become more so.

6

foxhelp t1_j0xs3ag wrote

I think that is where the other comment comes in that education needs to change / improve. Cause if you can google the answer, (or just ask chatgtp) does it make sense to be asking the question anymore as a form of evaluation?

my other comment goes as follows:

"The high school principal I talked with said it is actually a good thing this came about, as it is forcing them to rethink:

  • what kind of questions they ask in class/essays
  • evaluation methods that have largely been static
  • learning outcomes"
3

VansAndOtherMusings t1_j0wbxah wrote

In addition to the essays which I trialed and got a great passing score. You can manipulate it into incorporating academic sources and real world use cases. Yes of course you still need to read it edit, add nuance but the more you interact the more personal it gets and the line between chatGPT and Grammarly is blurred to all hell.

You can even paste your resume and have it write you a cover letter based on facts from your résumé incorporating the following job description: (pasted here)

And it works magnificent. Again still need to edit and clean up but it gets the majority of things right.

3

ApatheticWithoutTheA t1_j0wcrml wrote

Since I’ve been looking for a new dev job I’ve probably had it write me 20 cover letters in the last week lol.

I just paste in the job description, paste in my resume points. And boom, customized cover letter that is better than anything I could write. This thing is amazing for that. It’s pretty much made cover letters a non issue at this point.

3

VansAndOtherMusings t1_j0wd87j wrote

Oh yeah 100% I even use it to answer the other silly questions of why are you excited to work here or what about our mission excites you and as long as that organization has been around before 2021 it answers all of those questions.

I think the true key is using the chatgpt api in some way to make some money. Even if it’s not life changing money just something.

3

Whaines t1_j0xnkur wrote

And an AI is reading them too!

2

ApatheticWithoutTheA t1_j0xool7 wrote

Which reminds me that I filled out about 15 applications only to find out that my new resume wasn’t being parsed correctly by one of the major ATS software products API (Lever).

I probably wasted 8 hours of my life on those only to find out that the parser was putting everything in the wrong spots.

1

qyloo t1_j0wvul3 wrote

Until you train a neural net on your own writing

3

3_layers_deep t1_j0x9qh1 wrote

You just need to change the prompt a bit.

Also, the tech will improve. Yeah, you might beat today's chatgtp, but its improving fast.

3

legitSTINKYPINKY t1_j0wk2g3 wrote

Have you used it? It doesn’t spit out the same things. Especially if you tweak it or tell it to change it completely.

2

DimiBlue t1_j0wureu wrote

The obvious way to fight this would be to legitimately research, input that data. If you have any uniqueness in your sources you'd get a unique output.

Or hell, just use it as an editor.

2

Frances_Zappa t1_j0uz8qp wrote

My friend is in school and says its still on the downlow, but that he knows people who have completed very intricate coding assignments. Essays comparing literature.

Im curious if I can use it to create music. Generate MIDI sequences and such.

43

chisoph t1_j0v1etd wrote

I was able to use it to generate some very simple LaTeX documents, like a resume template. It's so fucking awesome

30

checker280 t1_j0vzfel wrote

This! I was trying to figure out how to write an intro letter to a corporation I hoped to work for that wasn’t geared toward new graduates or free internships and it offered a few templates easily

5

hus_k_ t1_j0v4o17 wrote

It is text only, I just tried haha. It'll tell you where to place a beat but can't output a file. If it was connected to another sub Ai that could do it, perhaps

6

TeH_MasterDebater t1_j0v8mkh wrote

In this video a guy managed to do it by asking ChatGPT to produce a melody in the form of a tuple expressing pitch and duration. Then he played it using Python and a library called Scamp. It's a pretty cool workaround to not being able to express music notes directly but I don't think it'll be winning any Grammy's soon.

https://youtube.com/watch?v=ogfYRBgzZPU&si=EnSIkaIECMiOmarE

15

uqde t1_j0vtpca wrote

There are ways around the text limitations if you’re creative enough. I saw a youtuber play chess against ChatGPT by using standard written-out chess notation. (The AI started attempting illegal moves after about 10 turns, but according to the person that was better than any other text-based AI he’s tested)

3

TangoDeltaFoxtrot t1_j0vg373 wrote

Yeah, I imagine it would be relatively simple for another program to translate text to music

2

elglas t1_j0w1g8o wrote

Our national broadcaster raves about it... It won't be on the down low much longer.

5

commodoregoat t1_j0vdmey wrote

Yeah it can make music & MIDI sequences. Search for Musenet, it's another OpenAI project.

3

ApatheticWithoutTheA t1_j0vvo6e wrote

It doesn’t do well at coding anything past a novice level right now.

If you give it something complicated, about half the time it will give you a very convincing wrong answer that appears it will work at first glance but is slightly off. Or it will give you an answer that works but isn’t done in a way that is considered best practice or is just outright a security issue.

It would probably mostly work for some freshmen/sophomore computer science classes though.

Source: I’m a Software Engineer that has been using it since the day it came out. It’s an amazing tool but it has a ways to go in regards to programming.

3

4hometnumberonefan t1_j0w3yvs wrote

Yeah it’s honestly screwed me over a few times and would have been better off just watching a youtube video. But still pointed me in the right direction.

2

checker280 t1_j0vz1un wrote

What is the copyright issues around you using their tool to come up with new creative sequences?

Say you used it to come up with a midi sequence that you use to create a billion dollar song… who wrote the song? It’s a for profit tool - do they deserve a cut?

2

VansAndOtherMusings t1_j0wc2vb wrote

You can use it to create fusion cooking recipes. Which I found pretty damn neat. May not taste good but it can blend and merge foods to create new dishes.

1

xenomorph856 t1_j0v1sek wrote

Not just schools. Not just ChatGPT, but AI in general is moving at a breakneck pace. I think the next 5-10 years will absolutely be disrupted by these new tools.

31

VoraciousTrees t1_j0vdilx wrote

Society isn't ready psychologically. This is like when the math teacher told you that you'd never have constant access to a calculator. Well, now your mom can complain you didn't even spend 5 seconds writing a ChatGPT prompt for a heartfelt birthday email.

39

drlongtrl t1_j0vq3hi wrote

I did prompt it to write that email. If I were to send that to my parents, it would be the nicest thing anyone has ever said or written to them.

Dear Mom,

Happy birthday! I hope you have the most amazing day filled with love, laughter, and all of your favorite things. You mean the world to me and I am so grateful to have you as my mother. Thank you for always being there for me, for your endless love and support, and for everything you do for our family.

I wish I could be there with you to celebrate, but I hope you know that I am thinking of you and sending all of my love from afar. You deserve the very best and I hope your birthday is as special as you are.

Love always, [Your Name]

14

thedoc90 t1_j0vtr47 wrote

My mom would immediately ask me what I was diagnosed with and how long I had left to live if I sent her that message.

12

atarka t1_j0vyoyl wrote

(hangs up) — Your foster children are already dead.

3

SerialChilIer t1_j0v2vcg wrote

I almost wish we could like… Halt the progress here haha. This is going to be massively disruptive and we need time to accommodate but I know the progression of technology waits for no one so guess we’ll just have to deal with it as it comes.

23

xenomorph856 t1_j0v3ygo wrote

100%. I have no doubt that it's going to be a shitshow that we're not even close to being ready for. But hey, that's the spice of life right? haha.. ha 😅

10

BLF402 t1_j0vrfz5 wrote

5 years definitely. 10 year where it will be the norm and the general population trying to get a good grasp at it

2

xenomorph856 t1_j0vskq0 wrote

I don't think we'll have a grasp of it, legally, politically, socially, culturally, or psychologically, for at least 50 years. It's going to take a while. Most of the world is barely coming to grips with the internet and social media.

2

realsingingishard t1_j0vjjhi wrote

It’s gonna get real Orwellian up in here. “If you cannot produce (when asked) video footage of you while writing this essay, with your screen shared as part of the video, you will automatically fail the assignment.”

14

DreamMaster8 t1_j0wfk5x wrote

Yeah until the ai can fake video based on yr face data. And then we are back like okd time where we need to stay in school to do it.

3

mrgulabull t1_j0wizjv wrote

Most remote proctored tests already work this way. Web cams on, starts with a 360 recording of your work area to ensure there is nothing to reference / cheat with, detects if your eyes move off screen, scans and monitors all processes running on your computer. In addition, a remote “viewer” can see your camera and hear your audio and chat with you if anything is suspicious.

I thought it was pretty insane when I first saw my nephew take a test like this, but it seems they’re already fairly well prepared.

2

3_layers_deep t1_j0xa52p wrote

That is basically the plan.

Google docs tracks your writing. Teachers are using that to check if the kids are actually writing papers or just copy/pasting in an AI one.

2

VoraciousTrees t1_j0vd320 wrote

There's currently an arms race between clever programmers building detectors, and lazy high-school students trying to evade them. You can grab popcorn and watch at the official ChatGPT discord.

8

checker280 t1_j0w1tfq wrote

It will be fascinating to watch the various groups (teachers and artists so far) pushing back against these tools as they try to control the new tech.

It feels like they are both fighting the same fight - how do you determine and judge the amount of human effort behind human/AI collaborations?

Did you see the latest strategy by the anti AI art activists? Since they keep insisting the output is a wholly original piece free from any copyright rules and restrictions they have been forcing the AI to make images of Mickey Mouse.

3

TheCentralFlame t1_j0vhyyu wrote

The concept of school is wrong currently. It should be about gaining tools to apply in the real world to solve problems. All written projects that aren’t directly addressing a real world problem and attempting to create change in the now so that a professor can grade a paper and everyone can forget about it forever is a waste of time in the first place, before anyone attempts to get a grade without putting in any work. Why pay to cheat so that you don’t have to learn? You’re paying to learn. Who cares if you cheat on a paper when you’re only harming yourself.

2

SerialChilIer t1_j0viqw5 wrote

You’re harming yourself and the credibility of your practice someday, whatever you do. Means less qualified people may get into the workforce if eventually AI can do a significant amount of assignments.

4

TheCentralFlame t1_j0vixxb wrote

It turns trained professionals into general labor. Got to learn to think for yourself.

3

SerialChilIer t1_j0vlsqs wrote

I was more thinking about doctors and jobs that many people rely their own safety on but

3

3_layers_deep t1_j0xaeq1 wrote

That is only one part of school. A big part of school is screening out candidates for future employers.

Students who write decent essays show they have a baseline level of intelligence, work ethic and ability to conform.

2

LordLordylordMcLord t1_j0vn5p2 wrote

The real answer is that essays were never actually useful. Schools as we know them today were created to train obedience, not scholarship.

2

UntoldTruth_ t1_j0vskhr wrote

I mean, I would think it would be pretty simple. Kind of like proctored exams in online classes, just have important writing assignments done in class/recorded.

2

SerialChilIer t1_j0vtygf wrote

That sounds awful though. What about ten page or more essays?

1

UntoldTruth_ t1_j0vvb0n wrote

You would have to record yourself when writing in lockdown browser so they can see you searching for your sources and whatnot.

2

3_layers_deep t1_j0xdegs wrote

Google Docs already tracks your writing process. They will just check to make sure it looks human.

2

truedoom t1_j0xcgoj wrote

Just my opinion, but maybe schools and universities need to stop getting students to memorize lots of facts, figures, etc and then regurgitate it on pages.

Maybe instead we should do things like show understanding of learning. Have a discussion with the students and have them demonstrate applied/practical knowledge.

(I'm sure someone is going to comment saying that they already do this or whatever, but I'm talking about the general concept of standardized testing, still hugely pervasive. It's deprecated. No one needs to spend time learning off anything they can easily look up on their phone. Instead they should be learning how to take knowledge and apply it)

2

chiefnak t1_j0vq8cr wrote

Probably some good ol in person hand written prompts in cursive

0