[gjsman-1000]

I’ve noticed there are situations where I’ll bring in some code from my project, and ask how to do something I know is almost impossible. (For example, accessing a session variable during my framework’s boot code.)

ChatGPT will, more often than not, come up with a stupidly complicated solution like to my above example that doesn't work. It takes an actual engineer to figure out why it is impossible and solve it correctly.

If I was hiring people, things like that would be great questions. It’s also so simple - keep track of the times GPT-4 has no idea of what it is doing, and use those as your questions.

[golergka]

Similar experience here. But writing down the problem and extracting relevant parts still helps me to think about it even when GPT-4 doesn’t come up with a good answer.