Submitted by sigoden t3_11pzc4i in coolgithubprojects
UseNew5079 t1_jc2a9t1 wrote
Reply to comment by sigoden in AIChat: A cli tool to chat with gpt-3.5/chatgpt in terminal. by sigoden
Oh i see. That makes sense. So if you try to send more than 4096 tokens the API will respond with error or will it charge you for >4096 tokens and just skip oldest?
sigoden OP t1_jc2f2mf wrote
You can't send more than 4096 tokens.AIChat will automatically evaluate the number of tokens used, and when it exceeds 4096, it will directly report an error and will not make a request
Viewing a single comment thread. View all comments