[magicalhippo]

My point is why must transformers be able to do everything?

edit: I don't mean to dismiss the work trying to figure out what they can do. That seems reasonable and valuable.

It's just, we're not trying to figure out how to tweak QR decomposition to solve arbitrary equations. It's a tool, a powerful tool, but it has some clear limitations.