Hacker News new | ask | show | jobs
by catlifeonmars 137 days ago
Seems like we should fix the LLMs instead of bending over backwards no?
1 comments

They’re good at it because they’ve learned from the existing mountains of python and javascript.
I think the next big breakthrough will be cost effective model specialization, maybe through modular models. The monolithic nature of today’s models is a major weakness.
Plenty of Java in the training data too.