[ai_critic]

Do you have any sort of hardware specs? Architecture? OS?

[mayankm]

Mac: Apple Silicon (ARM64), M1–M4. Windows: x64 (Intel/AMD)

4-8B param models work on laptops but the output isn't great. Gemma 12B is decent and 36B is pretty good but both need a Mac Studio or above.