Comments

You must log in or register to comment.

Nostr0m t1_iwi88bi wrote

I tried out the demo on their website. I think the idea sounds very promising, but its performance was pretty lacking. It does talk about the topic you provide and the format looks appropriate, but there are elementary factual and logical errors in the examples that I tried.

11

Akimbo333 t1_iwjwbjq wrote

Well it is new! Might just need a couple of updates!

7

pentin0 t1_iwkf51v wrote

Likely not. Solving some of these problems might turn out to be equivalent to creating an AGI.

Galactica might still be great for purely summarizing and reviewing purposes and thus, would still help accelerate scientific progress

12

lucpz t1_iwhcvkw wrote

Interesting. Is it feasible to fine tune the mode with selected literature on a single machine / GPU? I'd love to have an AI assistant when going through papers / lit review.

5

Ok_Analyst_2113 t1_iwhiwgp wrote

It’s already here ( using gpt3) www.explainpaper.com, you upload a pdf of the paper and highlight on the paper that you want explained and it will do so in non - technical language, you can even ask questions about the paper. Of course it’s not perfect but it’s a good step in the right direction, use your judgment when reading the AI/GPT3 generated explanations.

5

Veneck t1_ix2ch12 wrote

Definitely not what he asked

1

Ok_Analyst_2113 t1_ix4msrz wrote

you are likely correct but i was just giving them something that might making reading papers a little easier, thank you for your input. If you know of something that is even better to use that is publicily available currently ( I know some more effective intergrations will be coming on board over the next few months) i would love to know about it. Thanks in advance.

1

blueSGL t1_iwict3h wrote

It seems to get a little funky depending on the prompt.

https://galactica.org/?max_new_tokens=400&prompt=Electromagnetism+

Also it includes what looks like image captions that could have been stripped prior to training

> "The electromagnetic spectrum, showing the major categories of electromagnetic radiation."

Edit: I can also see what it means by "hallucinate text" (using a topic I'm very familiar with)

https://galactica.org/?prompt=rigging+in+autodesk+maya&max_new_tokens=400

you can certainly set limits and the rest but most of these don't have a dedicated button, or if there is a button it's burred inside multiple menus that you need to be guided too.

But I'm still amazed at just how good this is on a topic that is not strictly 'scientific'

Edit 2: ok I'm going to stop playing with this now because the temptation to shitpost is becoming too damn high.

https://galactica.org/?prompt=the+correct+way+to+bake+bread+&max_new_tokens=400

5