AIChat: A cli tool to chat with gpt-3.5/chatgpt in terminal.Submitted by sigoden t3_11pzc4i in coolgithubprojects
sigoden OP t1_jc22w3y wrote
Reply to comment by UseNew5079 in AIChat: A cli tool to chat with gpt-3.5/chatgpt in terminal. by sigoden
AIChat has a max_tokens limit: https://github.com/sigoden/aichat/blob/4a74f5cd72160585721dbce1e92c110125d046dd/src/config/mod.rs#L263
UseNew5079 t1_jc2a9t1 wrote
Oh i see. That makes sense. So if you try to send more than 4096 tokens the API will respond with error or will it charge you for >4096 tokens and just skip oldest?
sigoden OP t1_jc2f2mf wrote
You can't send more than 4096 tokens.AIChat will automatically evaluate the number of tokens used, and when it exceeds 4096, it will directly report an error and will not make a request
Viewing a single comment thread. View all comments