Hacker News new | ask | show | jobs
by ganeshkrishnan 612 days ago
>Llama Workspace connects to AI providers like OpenAI and Anthropic via API. In the API, each word for the most commonly used model (GPT-4o at the time of writing) costs approximately $0.000025. Therefore, to break even with the ChatGPT Teams license, which costs $30/seat/month, you would need to generate 1,200,000 words.

I would debate this one. As a "normal" user of chatgpt with around 10-20 questions a day, I can exceed this $30 per month because

1) it's not a word per se but token. A lot of the words are tokenized.

2) for each chat, for each question all the context above is re-sent and counts for cost.

I think pivoting towards self hosting llama models and charging for them might be more profitable to you and to the users.

1 comments

The data we provide about savings is based on the actual usage of our early adopting companies. It includes data from marketers, legal counsels, developers and support agents.

So for example, your scenario of 20 questions a day for 30 days: - Monthly queries 20*30 = 600 queries/mo - Model gpt-4o ($2.5/M input, $10/M output) - Average input tokens 1,000 (actuals are much lower) - Average output tokens 400

=> Cost per run $0.0065 => Monthly cost $3.90

PS: True, We deliberately used "word" and not token, in some context, so that anyone can easily understand it.