While the engineering on this project sounds super interesting, I hope you realise how dangerous this tool is. Other responses have already discussed the possible dangers better than I would have. But the risk of letting a convincing-sounding statistical text predictor trained on research data act as a substitute for curated medical advice from practitioners should not be understated. Bad medical advice can at worst cost lifes. Please be careful with this tool and add clear disclaimers that this does not constitute professional medical advice.
StarInABottle t1_j0fzlzw wrote
Reply to [P] Medical question-answering without hallucinating by tmblweeds
While the engineering on this project sounds super interesting, I hope you realise how dangerous this tool is. Other responses have already discussed the possible dangers better than I would have. But the risk of letting a convincing-sounding statistical text predictor trained on research data act as a substitute for curated medical advice from practitioners should not be understated. Bad medical advice can at worst cost lifes. Please be careful with this tool and add clear disclaimers that this does not constitute professional medical advice.