[throwa356262]

I thought it was easier to find a possible cut in a MoE where the amount of data transferred between layers is very small (kilo bytes) while in dense architecture this is much harder?