Hacker News new | ask | show | jobs
by bluechair 52 days ago
“What’s the memory bandwidth (GB/s) of the device holding the model weights?”

Isn’t the recommended option going to be dog slow at 256 GB/s.