Viewing a single comment thread. View all comments

X-msky t1_j765co5 wrote

Reply to comment by visarga in Possible first look at GPT-4 by tk854

You assume humans have 100% accuracy?

12

visarga t1_j76lslh wrote

Oh, I can tell you stories about human accuracy. At some point I re-labelled the same test set three times and was still finding errors. My models surpass untrained human accuracy, but still need hand holding, there's one error on every page on average. Humans do more cross checking and correlating, filling a gap in AI.

6

purepersistence t1_j7689y4 wrote

If you're debugging code you don't have to be accurate until the problem is fixed. Mistakes will be common. Accuracy is not absolutely necessary. But competence is. It will be a long damn time before something like chatGPT will find an fix subtle bugs that occur in a production system with many interacting services distributed across multiple computers running software controlled by different corporations.

2