Submitted by Destiny_Knight t3_11tab5h in singularity
damc4 t1_jck9vp9 wrote
Reply to comment by Intrepid_Meringue_93 in Those who know... by Destiny_Knight
If my understanding is correct, your comment is misleading.
They didn't create a LLM comparable to GPT-3 with a fraction of cost, but fine-tuned Llama model to follow instructions (like text-davinci-003 does) with a low cost. There's a big difference between training a model from scratch and fine-tuning it to follow instructions.
Intrepid_Meringue_93 t1_jcka5gk wrote
Due to your comment and others I'll reword mine.
Viewing a single comment thread. View all comments