[moonchrome]

But here's what happens when I try that :

  Me : I don't understand this publicly documented AWS service with plenty of OSS examples, can you suggest how I would solve some edge case X
  GPT : Oh that's easy, invents bullshit that sounds exactly like what I need 
  Me : Googles the shit the GPT came up with and can't find any references
  Me : Maybe there is something similar - spends more time searching
  Me : GPT you're wrong - your solution doesn't exist 
  GPT : Oh sorry, here's the correct solution, comes up with more bulshit
  Me : Googles the shit that GPT came up with and can't find any references
  Me : Starts googling and solving the problem on my own
  Me : Finds out X can't be done with AWS service

I've had this flow many times now, it never resulted in valuable output from GPT vs just Googling since I need to verify everything anyway.

Or

  Me : Review and come up with improvements to this code : CP code
  GPT : Suggest bullshit improvements, gives factually wrong reasoning, makes code worse
  Me : Points out everything wrong 
  GPT : Suggest other bullshit improvements
  Me : Points out everything wrong
  GPT : Returns basically identical code to input

Or

  Me : Propose a design to this technical problem 
  GPT : Implements the solution in the most roundabout way and suboptimal way

IMO if I'm not sure what the output should be GPT is less than worthless it's actually convincingly misleading.

[Toutouxc]

Is that with 3.5 or with 4? 4 is usually not afraid to tell it doesn’t know.

[moonchrome]

I've upgraded to 4 ASAP, all those examples are with 4. I tried 3.5 buy it was completely useless, 4 actually started giving sane output but still lying and hard to verify.

My only use case so far is stuff like "translate this model to openapi schema" because it was faster than setting up the tool, and similar tasks that are easy to verify and boring to type.