Hacker News new | ask | show | jobs
by zozbot234 69 days ago
Should run just fine with CPU-MoE and mmap, but inference might be a bit slow if you have little RAM.