|
|
|
|
|
|
by cpburns2009
77 days ago
|
|
|
The NPU works on Linux (Arch at least) on Strix Halo using FastFlowLM [1]. Their NPU kernels are proprietary though (free up to a reasonable amount of commercial revenue). It's neat you can run some models basically for free (using NPU instead of CPU/GPU), but the performance is underwhelming. The target for NPUs is really low power devices, and not useful if you have an APU/GPU like Strix Halo. [1]: https://github.com/FastFlowLM/FastFlowLM |
|
|