[ChrisRackauckas]

As mentioned in my post, ComponentArrays.jl will represent it columnarly and uses that for doing this efficiently with GPUs and automatic differentiation.