Y
Hacker News
new
|
ask
|
show
|
jobs
by
yangcheng
1023 days ago
but for code llm to be useful , the local machine need to have some very powerful GPU
1 comments
jasonjmcghee
1019 days ago
not true anymore. give codellama-7b-instruct a try. Just install Ollama. Pretty mind-blowing performance for the ram it uses and how fast it is. It's in the ballpark of chatgpt-3.5-turbo for code related stuff
link