At any rate, no it's not really limiting.
https://tidybot.cs.princeton.edu/
https://deepmind.google/discover/blog/rt-2-new-model-transla...
https://wayve.ai/thinking/lingo-natural-language-autonomous-...