Hacker News new | ask | show | jobs
by prabhanjana_c 13 days ago
Great, yes with samosa app can see details, it is 6.52tok/sec, 4.05GB memory. Use case, I have been waiting was to run some agents in my Mac continuously with local models, but without my Mac getting heated. Seems I can experiment with samosa inference engine.