|
|
|
|
|
|
by storus
360 days ago
|
|
|
You need at least 5x Pro 6000 (for smaller contexts), let's say Max-Q edition running at 300W, so overall you get a minimum of 1500W. You get around 6 tokens/second which is not great but not terrible. If you use very long prompts, things get bad. |
|
|