Viewing a single comment thread. View all comments

darkbluetwilight OP t1_jdy6eu6 wrote on March 28, 2023 at 1:23 AM

Reply to comment by rshah4 in [D]Suggestions on keeping Llama index cost down by darkbluetwilight

Nice suggestion thanks! llama-index currently uses an embedding version of Ada which has negligible pricing (0.0002/1000tokens I think) The once-off index creation (1.3million tokens) cost about 40c.
It was the AI text generation costs that was killing me.