See the yellow benchmark (matrix multiply). I suspect it's memory-related.
[1] https://julialang.org/benchmarks/