[Animats]

Makes me wonder if you could train a machine learning model to take one or more football match video streams as input and turn them into a live 3d model.

It's been done.[1] Not for American football, for soccer.

[1] https://grail.cs.washington.edu/projects/soccer/soccer_on_yo...