Hacker News new | ask | show | jobs
by illiac786 21 days ago
I don’t understand your calculation, can you elaborate? At 25USD/Mtk output, assuming your 20tk/s, I generated/saved (minus power costs) ~15k$ in a year.

Granted, it won’t run 24/7, but over a couple of years, this is definitely cheaper.

1 comments

This can’t run any models that cost $25/mtok lol. I think the fastest model it’ll reasonably run will be GPT-OSS 120B which costs $.05/mtok.

This is a laptop for CUDA devs and AI larpers.