[TaylorAlexander]

I just wanted to point out that the latest (RTX+) Nvidia cards support hardware dense optical flow calculation which sounds really fast from their docs. I quickly checked the repo for TFA but didn’t see mention of it. It would be interesting to see their method when designed to utilize hardware calculated optical flow, if that would help at all.

Here’s the NVIDIA library: https://developer.nvidia.com/opticalflow-sdk

I’ve played with the NVENC hardware and it’s fast! I’ve not specifically tried the hardware optical flow calculation but docs say it can process flow for 4k video at 150fps!