[fspoettel]

I guess we are two then, I feel the pretty much the same way as you. I might be completely wrong about all this, but it is getting to a point where it feels like I'm getting gaslit when I compare it with my own experience with these tools so far.

[naasking]

Crafting good prompts makes a big difference. Also, after it gives you an answer, say you think there's an error and ask it to check its own result. It will often correct itself. This self-reflection ability leading to more accurate outputs was pointed out in the new Reflexion paper:

https://nanothoughts.substack.com/p/reflecting-on-reflexion

https://twitter.com/Orwelian84/status/1639859947948363777

[naasking]

Here's another good thread about it:

https://twitter.com/ericjang11/status/1639882111338573824

[fspoettel]

Thanks for the links, appreciate it!

[maxdoop]

Genuine question as I definitely need more to balance my own thinking —

What has your experience with GPT been? For me, GPT-3 was not really useful as a software dev.

But GPT-4 is miles ahead of that. It’s helped me write code maybe 4-8x faster than usual, and has even allowed me to debug existing issues far, far quicker and more accurately than I’d ever be able to on my own.

Part of the gap very well might be my own mediocrity with development . I wouldn’t argue that folks with far superior skills and novel challenges day-to-day might be unimpressed.

But as an average dev writing pretty boring code (REST APIs and system integration mostly), I’ve been blown away by GPT-4. I am pretty well compensated and have been in the field for 10 years, too; but I am aware of my own shortcomings.