Hacker News new | ask | show | jobs
by brownfox 1195 days ago
Despite the affordable API, complex contexts can result in excessive token usage and potentially exceed the token limit, leading to high costs.

Balancing a responsive and cost-effective system while adopting a large knowledge base remains a challenge.