Hacker News new | ask | show | jobs
by yangcheng 1023 days ago
but for code llm to be useful , the local machine need to have some very powerful GPU
1 comments

not true anymore. give codellama-7b-instruct a try. Just install Ollama. Pretty mind-blowing performance for the ram it uses and how fast it is. It's in the ballpark of chatgpt-3.5-turbo for code related stuff