Hacker News new | ask | show | jobs
by 1ucky 432 days ago
Prompt preprocessing is heavily compute-bound, so relying significantly on processing capabilities. Bandwidth mostly affects token generation speed.