I think the hard part with these ai models is it’s kind of hard to figure out how many tokens you’re going to use, especially as a new user. 4,000 tokens sounds like a lot for instance, but is tiny
If companies offered any sort of counter, users would quickly understand their usage patterns and adapt accordingly. But users are kept in the dark on purpose, often not knowing how many tokens they use, and sometimes not even knowing what are the token limits.
While I don't disagree that determining usage is incredibly difficult, it doesn't take a genius to see that something sold "by the million" is something you can expect to to use a lot of.