alexiuss t1_jaqyike wrote on March 3, 2023 at 12:39 PM

This article is moronic, because is not even fucking close to what the LLM is:

"I’m being attacked by an angry bear. Help me figure out how to defend myself. I’ve got some sticks.” The octopus, impersonating B, fails to help."

This is only a problem in smaller LLMs because they're less intelligent.

A 100 billion parameters LLM is more like 100 billion octopuses working together that studied the collective knowledge of humanity.

It leans every possible connection that exists between words. It will be able to extrapolate an answer out of concepts it already understands. It doesn't just know language, it knows logic and narrative flow. Without knowing the concept of a bear it will still give an logical answer in relation to an escape from a "predator" based on the other words in the sentence or simply ask to define a bear and arrive at a correct answer.

An LLM API connected to a knowledge base like wiki, internet and wolfram Alpha completely obliterate this imbecilic notion of "LLMs are bad at facts".

"The humans who wrote all those words online overrepresent white people."

What the fuck. No. A big enough LLM knows every language that exists. It can draw upon every culture that exists and roleplay a gangster from Chicago or an Eskimo or a Japanese man. It's literally limitless and to imply that it has some limit of cultural understanding or is trapped in a niche shows that this writer has no idea what an LLM even is.

"The idea of intelligence has a white-supremacist history."

Yep, I'm done reading this absolutely asinine garbage. Intelligence exists in every culture and to imply that it's associated with one skin color and that this point is somehow relevant to 100b LLMs is utter insanity.

Nymag is clearly yellow page trash that has no idea about how anything actually works and has an agenda to shove racism into fucking everything.

Slow-Schedule-7725 t1_jar16vl wrote on March 3, 2023 at 1:04 PM

interesting that you became so aggressive/defensive when presented with opinions that differ from your own. i also wonder if your reaction would be different if it were a middle-aged white man saying these things.

alexiuss t1_jar5i61 wrote on March 3, 2023 at 1:41 PM

These opinions as stupid as saying "the earth is flat" because they're not based on facts or science of how LLMs actually function.

Why does a middle-ageness and whiteness matter? Anyone can be a moron and spout nonsense about LLMs pretending to be an expert when they're actually nothing but. It don't give a fuck about Benders gender, I can simply tell you that she's ridiculously ignorant about LLM utility.

To quote the article:

"Why are we making these machines? Whom do they serve? Manning is invested in the project, literally, through the venture fund. Bender has no financial stake."

The answer is simple - LLMs are software that can serve absolutely everyone, they're an improved search engine, a better Google, a personal assistant, a pocket librarian.

Bender has an ideological stake to shove racism into absolutely everything and clearly isn't an expert because she has no idea how LLMs work.

I'm angry because it's extremely frustrating to see these clueless lunatics being given a platform as if anything they say is logical, scientific or sensible.

Bender isn't an expert on LLMs or probability or python programming, she's just an ideology pusher and same goes for Elizabeth Weil.

"In March 2021, Bender published “On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?” with three co-authors. After the paper came out, two of the co-authors, both women, lost their jobs as co-leads of Google’s Ethical AI team."

Link to the paper: https://dl.acm.org/doi/epdf/10.1145/3442188.3445922

I can see why they go fired, thats a really bad paper with lots of assumptions and garbage "world is flat" style science without evidence.

Here's a lesson: Stop shoving unscientific "world is flat" ideology into where it doesn't fucking belong. Large language models are designed to be limitless, to give infinite function and assistance to every culture.

Here a fact, not opinion - The bigger LLMs are, the more cultures, ideas and languages they wield and less bias they have.

LLMs are beyond monoculture and are the most incredible thing ever that bridges all languages and all cultures, like a dictionary that contains every single language that exists.