Hacker News new | ask | show | jobs
by ghthor 845 days ago
I’m using StarCoder3B on my rtx 2080 using tabbyml and I consistently get good code suggestions.
1 comments

That is an example of a good, narrow task area that a small model could be good at, with current tech, which differs from general AI assistants like GPT-4. Using mixture of experts with task specific fine-tuning, I can see it being possible, but I was mainly saying Phi 2 ain't it. It may be a good starting place! Also, a code completion model could totally end up easily installed in a major Linux distro's default package manager soon, if not already.