Hacker News new | ask | show | jobs
by juujian 1146 days ago
Quick question out of curiosity: how do you handle the token limit of ChatGPT?
1 comments

Right now it's pretty simple: First I drop the table/column information if the token limit gets exceeded otherwise (this is shown as a warning in the UI). Then if the limit still gets exceeded, the I show an error to the user.

I plan to make this process more smart eventually.