ivalm t1_jc7e22p wrote on March 14, 2023 at 4:12 PM

Reply to comment by modeless in [R] Stanford-Alpaca 7B model (an instruction tuned version of LLaMA) performs as well as text-davinci-003 by dojoteef

Yup, catastrophically failed all my medical reasoning prompts (that davinci-2/3/ChatGPT get right)

ivalm t1_it6c261 wrote on October 21, 2022 at 6:49 AM

Reply to [D] Discussion Panel for FOSS Instruct by FerretDude

Task oriented dialogues following a description of the task.

From medical domain example:

————

Ask what symptoms the patient is feeling. For each symptom ascertain symptom duration, if it is worsening or improving, if there alleviating or aggravating factors. For symptoms with uncertain location assert symptom location.

Doctor: Hi, what brings you in here today?

Patient: I’ve been having a sore throat and pain in my face for the past week.

Doctor: [start generation]

—————

In particular such tasks (after multiple dialogue turns) are hard because one needs to be coherent through the conversation. This is something eg davinci-2 is much better than davinci.