Hacker News new | ask | show | jobs
by adrian17 269 days ago
The commit names look very weird too, feel more like marketing speak:

> BREAKTHROUGH: Fix critical ID mismatch in Cap'n Web protocol

> TIER 3 ULTIMATE: Extreme Stress Tests & Advanced Capability Composition

> Achieve Cap'n Web protocol mastery with perfect capability composition (note: this exact commit name is repeated another time)

The commit descriptions are even worse. If they’re so blatantly not written for anyone to read, why bother generating them at all?
2 comments
brian_meek 268 days ago
OP here. :-) (feel like I should put an emoji here). My focus as I "built" this was getting to a correct implementation, and putting in place guards and context to achieve that. As I moved through the process I added more and more ways to eval progress toward that. An area I didn't invest any of my effort in was commit messages, and some of them caused me to spit take as I saw them go by. I think this is something that can definitely be improved, and this conversation is fuel for thought on how to do this.
link
svieira 268 days ago
Yeah, LLM-created commit messages verge on "Brilliant Paula" for some reason. It's probably because nobody bothers to RLHF commit messages (yet).

https://thedailywtf.com/articles/the_brillant_paula_bean

link