|
|
|
|
|
|
by krasin
443 days ago
|
|
|
DeepSeek R1 has 671B parameters. If you want to run at 8 bits/parameter (the native format for DeepSeek R1, in which it was trained, so the top performance possible for the model), one would need about 32 Blackhole p150a ([1]), which is around $42k and 10kW power consumption. So, yes, you can run DeepSeek R1 on it, but there are cheaper options (if we only talk about inference). 1. https://tenstorrent.com/hardware/blackhole |
|
|