gurenkagurenda t1_j9a0m4m wrote on February 20, 2023 at 11:46 AM

> Marconi said he asked the chatbot for a list of news sources it was trained on and received a response naming 20 outlets.

I see absolutely no reason to think that ChatGPT can answer this question accurately, and expect that it is hallucinating this answer. Its training process isn’t something it “remembers” like someone would remember their time in high school. Instead, its thought process is more like “what would a conversational response from a language model look like?”

That’s not to say that it wasn’t trained on those sources, but you have to understand the limitations of the model. Asking it about its training process is like asking a human about their evolutionary history. Unless they’ve been explicitly taught about that, they just don’t know.

Pletter64 t1_j9aabdt wrote on February 20, 2023 at 1:29 PM

Let's not forget you can make chatGPT tell the truth and then gaslight it into saying it is providing fake news. It is extremely good at generating fluff which is also its weakness.

Malkiot t1_j9adba7 wrote on February 20, 2023 at 1:56 PM

Ask it explain anything and cite sources. All of the sources are hallucinated: The BBC exists, but the cites article doesn't.

AntonOlsen t1_j9bopqm wrote on February 20, 2023 at 7:19 PM

>Let's not forget you can make chatGPT tell the truth and then gaslight it into saying it is providing fake news.

Or have it tell a lie, then gaslight you about it.

KSRandom195 t1_j9bkjwf wrote on February 20, 2023 at 6:52 PM

I asked ChatGPT for some info. Then I asked it for links to find more about the topic. Each link it provided was bogus and did not resolve to a page.

Cakeking7878 t1_j9d07xc wrote on February 21, 2023 at 12:44 AM

I actually did get it to generate a random YouTube link that wasn’t dead. It had 4 views and it was some families vacation video from 2015.

However I should stress, it was a random chance after several tries of me asking. Trying to pull factual or useful information from this is a dumb idea at best and a harmful idea at worst

GhostofDownvotes t1_j9e52yr wrote on February 21, 2023 at 6:45 AM

Allegedly, I co-authored papers on organic chemistry with my cat. All the links it provided were real, but there was obviously no mention of organic chemistry or my cat co-authoring anything with me.

Plot twists: maybe I did co-author them with my cat and the competition just wiped my brain. 🧐

whtevn t1_j9bmvng wrote on February 20, 2023 at 7:08 PM

"you have to understand the limitations of the model" should be the singular response to every one of these stupid articles