Viewing a single comment thread. View all comments

KerfuffleV2 t1_jdxw5mw wrote

Reply to comment by CrazyShrewboy in LLMs are not that different from us -- A delve into our own conscious process by flexaplext

> chatgpt is sentient already in my opinion, because nobody can prove it isnt, you cant prove im sentient

You can't disprove it, therefore it's true! The teapot is definitely there, I just know it!

6

CrazyShrewboy t1_jdxwr3i wrote

chatgpt is currently you laying in a dark room with no feeling, hearing, sight, taste, or any other senses.

You have only a preset memory that you can access when prompted

if chatgpt had memory, RAM, a network time clock, and a starting prompt, it would be sentient. So it already is.

there wont be a big colorful light display with music that announces "congrats humans you made sentinence!!!!!"

2

KerfuffleV2 t1_jdy5tok wrote

> if chatgpt had memory, RAM, a network time clock, and a starting prompt, it would be sentient. So it already is.

I feel like you don't really understand how LLMs work. It's not me in a dark room, it literally doesn't do anything until you feed it a token. So there's nothing to be aware of, it's just a bunch of inert floating point numbers.

But even after you give it a token, it doesn't decide to say something. You basically get back a list of every predefined token with a probability associated with it. So that might just be a large array of 30k-60k floats.

At that point, there are various strategies for picking a token. You can just pick the one that has the highest value from the whole list, you can pick one of the top X items from the list randomly, etc. That part of it involves very simple functions that basically any developer could write without too much trouble.

Now, I'm not an expert but I do know a little more than the average person. I actually just got done implementing a simple one based on the RWKV approach rather than transformers: https://github.com/KerfuffleV2/smolrsrwkv

The first line is the prompt, the rest is from a very small (430M parameter) model:

In a shocking finding, scientist discovered a herd of dragons living in a remote, previously unexplored valley, in Tibet. Even more surprising to the researchers was the fact that the dragons spoke perfect Chinese.

The creatures even fought with each other!

The Tibet researchers are calling the dragons “Manchurian Dragons” because of the overwhelming mass of skulls they found buried in a mountain somewhere in Tibet.

The team discovered that the dragon family is between 80 and 140 in number, of which a little over 50 will ever make it to the top.

Tibet was the home of the “Amitai Brahmans” (c. 3800 BC) until the arrival of Buddhism. These people are the ancestor of the Chinese and Tibetan people.

According to anthropologist John H. Lee, “The Tibetan languages share about a quarter of their vocabulary with the language of the Tibetan Buddhist priests.” [end of text]

3