[lolinder]

Have you looked into OpenAI's GPT-4o pricing lately? They charge $10 for 1M output tokens, or 500k tokens for the price of a $5/mo VPS.

If we assume a generous 2 tokens per word on average (OpenAI suggests it's actually 3 tokens per 4 words), that's still 5 full 50k word novels worth of text every month for the price of a single DigitalOcean droplet.

[worldsayshi]

This pricing cannot be sustainable in the long term right? The LLM companies are currently bleeding money.

[bloomingkales]

It’s not sustainable for anything other than static content generation. Any type of back and forth with LLM is simply too costly.