Training time is a massive constraint on advancement of the science, so at the very least the field would progress much faster and be much more accessible to researchers.
I feel people are overlooking the OP's mention of parallel improvements in storage and speed of access. While there are physical limits to this, I feel like capabilities will continue to expand not so much in terms of pure speed as in better automation of parallelization and resource allocation.