Hacker News new | ask | show | jobs
by hmottestad 246 days ago
I don't think anyone is pretending that a Macbook Pro can compare to 8 H100 cards from Nvidia in terms of LLM training or for serving LLMs. But you can buy an awful many macbooks for the price of 8 H100 GPUs.

But if your workload belongs on 8 H100 GPUs then there isn't much point in trying to run it on a macbook. You'd be better served by renting them by the hour, or if you have a quarter million dollars you can always just purchase them outright.

The H100 is just an example, this is true for any workload that doesn't fit on a laptop.