[throwawaycopter]

Correct me if I'm wrong, but answering questions for known answers is precisely the kind of thing a well trained LLM is built for.

It doesn't understand context, and is absolutely unable to rationalize a problem into a solution.

I'm not in any way trying to make it sound like ChatGPT is useless. Much to the opposite, I find it quite impressive. Parsing and producing fluid natural language is a hard problem. But it sounds like something that can be a component of some hypothetical advanced AI, rather than something that will be refined into replacing humans for the sort of tasks you mentioned.