I've done a lot of experimentation in this space with ChatGPT4 and also the Wolfram plugin. I've mixed but generally good results when working through basic physics problems though you have to be careful about how you prompt. In particular, you want to break down the problem into smaller bite size chunks and eliminate ancillary information. Interestingly, even when it gets the math and algebra wrong, I still find it useful because it gives me hints about how to approach the exercise. Sometimes having several parallel conversations with the Wolfram plugin, for example, can set you on the right track. I expect there will be significant improvements in this arena in the short term.
That doesn't sound anything like a product suited for young learners, many of whom are unprepared to practice the finesse you're talking about and many of whom will want to put no more effort in than strictly necessary.
That sounds like something an especially patient autodidact might use to automate some busy work or help them explore the basics of a new topic, which is fine, but not what the article is trying to champion.
I believe your insights are accurate. Nevertheless, in the age of AI, it's evident that critical thinking remains indispensable. The value of a liberal arts education, which fosters the age-old practice of intellectual scrutiny, cannot be overstated, LLMs or not.