[braingenious]

I agree! I am excited for the future of all this.

Today I managed to get Alpaca 13B running locally on my laptop and I’m really impressed. I look forward to being about to run 65B with my next hardware upgrade, though I suspect something even better will be available by the time I get around to actually buying anything.

[mrandish]

Running a decent LLM on a laptop is super impressive though I expect I'd run a personal LLM on a server for 24/7 availability, backup, etc. It'll be interesting to see if people like us HNers end up running our own full LLMs on open source for privacy, security and control reasons or if an acceptable solution is worked out which allows keeping our personal data blobs separate but able to be temporarily securely accessed.