Hacker News new | ask | show | jobs
by bing_dai 996 days ago
Hello! Thanks for the question. I do not myself restrict tokens/session. The model I am using GPT-3.5-Turbo-16k (https://platform.openai.com/docs/models/gpt-3-5), allows max 16,385 tokens in total per input/output.

So far, I found that each ~10 minute video uses around 1000 tokens. It costs me about 3 cents to summarize, which is not too bad as I don't have many users, and users haven't been requesting summaries for super long videos yet.

If this sites gets a lot of interest, I might start restricting something :)..

GPT 3.5 Pricing: https://openai.com/pricing