Hacker News new | ask | show | jobs
by scubbo 31 days ago
> It was fun, easy, and only cost $7k for a M5 Max MBP with 128GB of unified memory.

Unclear to me whether this means $7k was the cost of the hardware that can run it, or if that was the token cost of implementation. The latter is surprisingly high; but the former is (to me?) a weird thing to share (if the whole point of this is that it can run locally, isn't that value undermined if it requires purchasing updated hardware to run?)

1 comments

Cost of hardware. They’re running a local LLM.