Viewing a single comment thread. View all comments

Cool_Abbreviations_9 OP t1_jdu3xlj wrote

Reply to comment by [deleted] in [D]GPT-4 might be able to tell you if it hallucinated by Cool_Abbreviations_9

It does appear to have some calibration capabilities

7

Rioghasarig t1_jdxs956 wrote

I really don't think your experiment makes much sense. Even if we could determine the confidence level of GPT there's no reason to believe asking it for its confidence level is an effective way of determining the actual confidence. As other people have asked the obvious question is "what's your confidence on these confidence reports"? The logic is baseless.

2