Hacker News new | ask | show | jobs
by tarun_anand 639 days ago
I am on a 2019 mac and finding it difficult too.

Best bet would be to start with a small language model?

1 comments

May I ask how small? From what I see on r/localllama, it seems that at least 3B and 7B ones are starting to be useful? Also I cannot use CUDA or modern AMD cards..