Viewing a single comment thread. View all comments

step21 t1_jabzt1w wrote

If you say you had a good understanding until then, what changed? The GPT architecture as far as I know in newer editions didn’t change completely, but made smaller changes and spent a lot of time on better data, better curation/guidelines etc.

27

professorlust t1_jacfxvl wrote

Regarding ChatGPT, I believe OP is frustrated not by the Transformer architecture but by the improvements made in the inference functionality.

That’s the real “black box” of GPT style LLMs and the least open

1