you can have it, the question is what will be accumulated errors in final result.

on some unrelated benchmark

I do not know, it is hard to say if you will be able to create sufficient dataset for your case.

first and/or most powerful AGI will likely be closed and owned by corp.

I think people amazed by progress speed, OpenAI got 10B fundning, they built strong team, and they can continue expanding system with missing components.

gpt is cool because it memorized lots of info, so you can quickly retrieve it. LM memorization abilities likely dependent on the size.

​

they don't have a6000 ada yet

> Based on my study, A6000 ADA has comparable performance to A100 on DL benchmarks. Is this A100 80GB spec a good choice?

it looks like you answered your questions yourself: 4 x a6000 ada will give you the best performance.

It still doesn't answer second question.

> Asimov's rules don't work

you jump to another topic. Initial discussion was that Azimov rules brought much more awareness, and you can't point on similar material results from Yudkovsky.

> Not that it wouldn't have happened without him but might've taken many more years to ramp up the same amount.

happened what exactly? what are the material results of his research?

I think Azimov's with his rules produces earlier and much stronger impact.

> I'm now a professional in the field of AGI safety

Lol, you adding AGI makes my bs detector beeping extremely loud.

Which AGI exactly you are testing for safety?

>but those didn't convince anyone to take it seriously

Lol, I totally got the idea that rogue robot can start killing humans long before I learn about Yudkowsky existance.

> Yudkowsky did.

could you support your hand-waving by any verifiable evidence?

Yes, and then reproduce results from both papers, check the code to see nothing creative happens in datasets or during training, and there are much more claims in the academia than one has time to verify.

What is IMG for GPT then there?

How come GPT performed better without seeing context compared to seeing text context?..

>which requires substantially fewer parameters while scoring higher, even in text-only domains.

Which tests in paper refer on text-only domains?

multimodal here means questions contain pictures.

So, it is obvious gpt would underperform since it doesn't work with pictures, lol?..

which field? ai danger awareness? It was in the terminator movie.

I don't know much about his practical achievements in this area.

I argued with him on hacker news, and he is very reactive when reading something he doesn't like.

I think my point still stands:

- Google didn't ship LLM as product yet, and now forced to catch up because lost innovation race (even you think they are not interested lol)

- OpenAI shipped multiple generations of LLM products already

> Palm beat GPT models in every major beachmark.

palm is much larger, which makes it harder to run in production serving many user's requests, so it is example of enormous waste of resources.

Also, current NLP benchmarks are not reliable, simply because models can be pretrained on them and you can't verify this.

> Most of the technologies being used by openai are either from Google or from Deepmind.

it is just indication that google and deepmind create theoretical concepts but can't execute it to complete product.

> Beats prior code generation sota by over 75%!

but on different metric: pass@50 vs pass@8x16

I am serious, knowledge graph is just many triples, and can be stored in relational DB, and the same is about other data, and then you can join them..

sql join?..