chatGpt is good at writing nice-looking prose. That doesn't mean its content is actually good, just well-ornamented.
In real life, people who are uneducated are bad at both reasoning and language expression. People who are generall well-educated are good at both. chatGPT ain't like us
Yeah, but what if you run them through an SAT prep course first? It is impressive relative to other NLP but it could not be a better illustration of exactly those criticisms that it's responding to. Extremely formulaic.
Chatgpt itself ain't better. One thing chatGPT struggles with is jeopardy-like queries, where you give an answer and ask the question. It failed even with simple answers like "four neutrinos".
Bing however (which I assume is running gpt4) is good at it
What’s also interesting is when it comes to standardized tests is that in minority circles we speak exclusively about ableism and classism. Classism being taking up a lot of said space in these collective conversations. I mean who has the time and money to study for these tests after just taking out loans for undergrad? ChatGPT’s training data really seems to be skewed towards the wealthy. That scares me.
I don’t think not mentioning a criticism of standardized testing means the model is necessarily biased... or “the training data is skewed towards the wealthy”. Whatever that means lol
fnordit t1_jcejm2y wrote
Ahaha, it has the mediocre-high-school-essay format down pat. Solid 4/5, if I'm remembering those grading scales right.