Hacker News new | ask | show | jobs
by rgbrgb 264 days ago
this is a good one, so fun. congrats and good work!

what's cost like rn with the lightweight model?

1 comments

The lightweight model is incredibly cheap. Cost so far today $0.06. It within the same order of magnitude as the per-request cost of the write to cloudflare KV storage (which I'm using to cache the inference result).