Hacker News new | ask | show | jobs
by moonchrome 1000 days ago
If it's anything like LLM for code review then I'd say it's not very potent.

No doubt it's good at paraphrasing code, deobfuscation sound like a good usecase. Other than that I've seen it mostly come up with bullshit :

- random opinions stated as fact (x makes code readable, y makes code simpler to understand, yada yada) - it's like a review from a mid level dev that finished reading Uncle Bob or some crap like that and suddenly there's 8 functions where there should be 2

- suggests changes that make the code subtly incorrect - like rewriting code with a different container type and messing up result ordering

- state false information like suggesting that a dictionary will be faster than array search (for fixed size/small array), or that some approach is faster because it doesn't allocate (but original didn't allocate either and the new approach actually does, it just hides it in a container), etc.

- can't catch complex logic bugs for shit, even with leading follow-up questions (once I figured out the problem and went back to see how long it would take GPT to figure it out)