Y
Hacker News
new
|
ask
|
show
|
jobs
by
a_t48
697 days ago
GP is likely referring to network latency here. There's a tradeoff between smaller GPUs/etc at home that have no latency to use and beefier hardware in the cloud that have a minimum latency to use.
1 comments
yjftsjthsd-h
697 days ago
Sure, but if the model takes multiple seconds to execute, then even 100 milliseconds of network latency seems more or less irrelevant
link