Viewing a single comment thread. View all comments

farmingvillein t1_j0ejk8l wrote

Check out // compare with https://crfm.stanford.edu/2022/12/15/pubmedgpt.html, if you haven't yet.

7

tmblweeds OP t1_j0eow0t wrote

Yeah just saw that! Definitely going to give it a test drive in the next few days.

3

SulszBachFramed t1_j0g22xz wrote

> (...) a new state of the art performance of 50.3% accuracy on the MedQA biomedical question answering task.

Oof, the fact that the accuracy is only 50% does not inspire confidence.

1