[Confusion]

  You might as well say that scarcity of energy is the only 
  thing between us and free ponies for everyone.

That's exactly what I'm saying, with the caveat that it will take time to get to the situation where everyone can turn the energy into free ponies. As you rightly point out, there is infrastructure required to make use of the free energy. However, if you would have free energy, that infrastructure will get much cheaper. The richer will sponsor infrastructure for the poorer, as has started happening more and more. We are slowly but surely succeeding in improving the living conditions of the poorest. The component cost of energy in everything is not to be underestimated. If you could eliminate that, things would drastically change.

The energy is there for the picking, but no country or company is trying hard enough. And why should they? What would they gain? That's the problem.