In some cases, it is much faster.
Consider Neural Stochastic Differential Equations, Flux is literally over 70,000x faster than Google's PyTorch-based implementation:
https://gist.github.com/ChrisRackauckas/6a03e7b151c86b32d74b...