|
|
|
|
|
|
by alecco
469 days ago
|
|
|
I like the guy but he is wrong. Besides the CUDA ecosystem, Nvidia hardware has a lot of features and a lot of things to yet optimize. Like optimizations by DeepSeek (non-CUTLASS custom models and DualPipe). I think Nvidia's current hardware has plenty of legs and that's why they are not rushed on releasing next gen chips. The actual challenger is Cerebras. No need to load (VRAM->SRAM) all the parameters for every batch . But they have yet to prove they can scale and support the custom stack. We'll see. |
|
|