[hotpotamus]

I did have a bit longer comment typed out but didn't follow through on it. That is to say that yes, for common code (or as a developer told me, stuff you've written before and just can't be bothered to find again), it can knock stuff out in seconds that might take me a few hours, so in that sense it is very impressive. But that's just writing code that's been written many times already, and I'm not a developer anyway. I think it shows that in truth, few of the issues we solve are novel.

[zeroCalories]

You're not supposed to ask it to implement something novel or large scale. You ask it how to use an api, or to refactor some code with a new class you made. You stack these up, and you can be way more productive than the person doing the equivalent of manual labor.

[hotpotamus]

It's a free text box, you can ask it anything you want, but yes; the answers to large scale questions have been quite lacking in my experience. But as a systems guy rather than a developer, those tend to be the actual problems that I have.