Hacker News new | ask | show | jobs
by avadodin 13 days ago
You can just ask any model to go do a code review and it will probably do better than no review at all but with rules you can make sure at least it processed inputs enough to produce a hallucinated reason which you can check for why a rule doesn't apply.

To me, that's worth losing some theoretical model performance and token efficiency unless you're using the small local models which basically lose all of that while trying to follow the rules.

1 comments

Definitely. Though my own experimentation is showing that with the small models it is worth working through the fewest words. I don't think Gemma will need too much prompting to not sound like a web dev blogger.