Submitted by vom2r750 t3_yqqyo7 in singularity
Comments
mooslar t1_ivrc6tl wrote
Sure hope it doesn’t have worse performance!
theferalturtle t1_ivt0xip wrote
My wife has Ankolysing spondylitis and I'd love to be able to check out all the research and maybe even have it summarized for the layman without having to spend hours just finding an article or paper I haven't read already.
visarga t1_ivt8r4i wrote
More recently GPT-3 can load 4000 tokens in the context. If you have a dataset of texts you can make a search engine that will put the top results in the context. Then GPT-3 can reference that and answer as if it was up to date.
Using this trick a 25x smaller model could have similar results with a big model, they had 1 trillion tokens of text in the reference.
Dry_Expert7006 t1_ivpqo52 wrote
The poem she made and the responses around robots not being a threat were a little terrifying. Really hope they add the ability to read/write. I can imagine the computer vision tools are capable.