Hacker News new | ask | show | jobs
by dwild 1287 days ago
Except they already sell API access for their AI and it seems like the right price, $0.0200 per 1k token for the best one, and my prompt right now are between 3k and 15k tokens. Doing a prompt is cheap enough for what it give, and there's no way it cost them more than that running it considering how quick it does it. They could easily do 2x that cost if it were too expensive to run for them, if not more. You can rent a server with 8x Nvidia A100 on lambdalabs for 8.80$/hr, let say my smallest prompt took 15 seconds (it didn't) and required that whole server (clearly not) it would cost them 3.7 cents to run my prompt, while costing me 6.2 cents, and lambdalabs would also make a profit on it.

Training the models weren't that expensive either, and that's a one time deal.