|
|
|
|
|
|
by Numerlor
239 days ago
|
|
|
I believe just inference is bandwidth limited, prompt processing and other tasks on the other hand needs the compute. As I understand it, the workstation is also as a whole focused on the local development process before readying things for the datacenters, not just running LLMs |
|
|