Hacker News new | ask | show | jobs
by razster 105 days ago
I run a local model on the daily. I have it making tickets when certain emails come in and made a small that I can click to approve ticket creation. It follows my instructions and has a nice chain of thought process trained. Local LLMs are starting to become very useful. Not OpenClaw crap.
1 comments

What vram you running to allow both a capable model to run and also everything else the device needs to run?