Hacker News new | ask | show | jobs
by verdverm 1158 days ago
Check out LLAMA-CPP
1 comments
cahoot_bird 1158 days ago
Looks like this was hacked together pretty quickly. This in CPU is exactly what needs optimized to run on more devices, if that's even possible..

I guess it will take hardware and software a while to catch up to compete with ChatGPT..

link
verdverm 1158 days ago
If you look at the news, yes it came together quickly, but it has also gotten a lot of performance upgrades which have made significant improvements.
link