Adghar

Adghar t1_ja15w61 wrote

Reply to How far off are we from not needing to learn languages? by AmericanMonsterCock

I hate to sound like a Luddite, but learning languages doesn't strike me as something people should ever want to stop learning. Language learning usually provides more benefits than just communication with others - you learn cultural context, different ways of seeing things, etc. Certainly, a universal translator would really come in handy, but even with the most effective and convenient translators out there, people would still want to learn other languages.

248

Adghar t1_j67nhc0 wrote

Reply to ELI5: How does ChatGPT work? by Zurbinjo

Currently, artificial intelligence (AI) and machine learning (ML), which ChatGPT make use of, are simply the science of statistics being applied heavily.

If you take a sample of 10,000 English sentences, you expect to encounter certain patterns. Maybe 3 of the sentences have "rock" after the word "the," maybe 15 of the sentences that contain 6 or fewer words contain "I." Depending on how frequently these patterns appear, you can make predictions; if 9,996/10,000 of those sentences have "rock" after the word "the" and you're given the word "the," you can predict that you should follow it with "rock."

Now take this principle and scale it up greatly with the most sophisticated pattern-finding levers the company could come up with for the program. Feed it examples of countless oceans of language in different contexts associated with different prompts. It's then a matter of calculating based on each model and coming up with the most probable word that should follow the previous word given the entire context (your question, the sentence, the paragraph, the conversation). At that point, you can reasonably expect the program to "act like" whatever the training data was. And the training data was well-labeled and captured across many contexts, allowing the program to feel intelligent.

50