No, Schmidhuber gave birth to the transformer in 1991.
https://x.com/SchmidhuberAI/status/1683870175299239937