Hacker News new | ask | show | jobs
by Rapzid 993 days ago
ChatGPT 4 may be better but CoPilot is terrible at making suggestions on algorithm work. It'll slip a -(x) in to parameters where it's supposed to be positive. Use the sim but wrong variable names. Swap parameters around. It's can be a nightmare and cost you way more time debugging than it saves typing.

Specifically with type-ahead suggestions I believe with typing you are more engaged in thinking about what is correct. With a CoPilot suggestion the tendency is to just skim it to see if it look good. And that's probably part of the problem; the LLM is trained on what looks good!

This may look good:

  computeNodeDistance(sourceNodesA, destNodesA, x, -1)

But it's supposed to be:

  computeNodeDistance(sourceNodesA, destNodesB, x, 1)

Good times.