This isn’t a limitation of neural nets, as early as 2018 we’ve had stable style transfer for videos, see https://medium.com/element-ai-research-lab/stabilizing-neura...