[grosswait]

If connection tracking wasn’t a thing, every UDP reply would be sent to every device on the network.

[zaarn]

Yes but your router might not interact well with Connection Tracking and UDP port forwards. Especially with such wide range ones. I know more than one case where port forwarding disables connection tracking for UDP on those ports.