Hacker News new | ask | show | jobs
by numpad0 11 days ago
People say they think it's faster than top of the line RTX 3070[1] and hands down the fastest GPU ever for local LLM purposes, and OTOH they're like Intel integrated graphics with RAM shared VRAM for ultra thin laptops, so the truth is either of that, or somewhere between those two. Probably wherever its TDP suggests.

1: (Laptop)

1 comments

> hands down the fastest GPU ever for local LLM purposes

Not really. On pure speed a 5090 will still comfortably beat a top end Mac configuration. Just constrained to 32gb mem ofc

Top Mac has mem throughput around the 900 mark while a 5090 is at 1800