Hacker News new | ask | show | jobs
by mayankm 4 days ago
Mac: Apple Silicon (ARM64), M1–M4. Windows: x64 (Intel/AMD)

4-8B param models work on laptops but the output isn't great. Gemma 12B is decent and 36B is pretty good but both need a Mac Studio or above.