[worik]

> The main bottleneck at this point is the cost of all of the token

Are you using Chinese models? Quite a bit cheaper, but maybe still too expensive?

[aleqs]

Yeah mainly deepseek, it performs near top pretty consistently in terms of price/output (with a basic quality measure). I would love to test with more models but that's not cost-realistic for me at the moment.