Hacker News new | ask | show | jobs
by itake 698 days ago
According to this tweet, Llama 3 costs about $0.20 per Million tokens using an M2.

https://x.com/awnihannun/status/1786069640948719956

In comparison, GPT3.5-turbo costs $0.50 per million tokens.

Do you think an old iPhone will less than 2x efficient?

1 comments

FWIW depends on cost of power. Where I live cost of power is less than half the stated average.