Viewing a single comment thread. View all comments

jsonathan OP t1_j3i0txg wrote

Reply to comment by uoftsuxalot in [P] I built Adrenaline, a debugger that fixes errors and explains them with GPT-3 by jsonathan

Yeah, right now it’s just a thin wrapper around GPT-3, but there’s a lot that could be done to improve it, like using static code analysis to build a better prompt or even training a more specialized model (like this).

107

ginger_beer_m t1_j3jlhaj wrote

How did you deal with incorrectness from ChatGPT?

3

jsonathan OP t1_j3joesx wrote

I didn't. Adrenaline won’t always correctly fix your error, but it can at least give you a starting point.

39

kelkulus t1_j3k8w2w wrote

Well for one, he's not using ChatGPT. GPT-3 is not the same.

18

danielswrath t1_j3l1fkb wrote

GPT-3 has the same problem though. ChatGPT is a successor of GPT-3, so it's not the same but it's not extremely different either.

7

Glum-Bookkeeper1836 t1_j3lhgfx wrote

I'm not sure if we know this for certain, but it appears to be davinci instruct 3 with a custom prompt prefix.

3

[deleted] t1_j3l3f45 wrote

[deleted]

1

jsonathan OP t1_j3l3xm5 wrote

I haven’t used this yet, but my understanding is it can explain code and generate unit tests. It can’t explain and fix errors.

5

cloudedleopard42 t1_j3p7pr3 wrote

is it possible to fine tune GPT for static code analysis ? if yes...what would be the training set looks like?

1