[nmfisher]

With current paradigms, yes. I'm hoping to see more focus on architectures that are more amenable to distributed training in the near future.