|
|
|
|
|
|
by Havoc
95 days ago
|
|
|
You can already run some models on the NPUs in the Rockchip RK3588 SBCs which are pretty abundant. A claude 4.6 they are most certainly not, but if you get through the janky AF software ecosystem they can run small LLMs reasonably well with basically zero CPU/GPU usage |
|
|