We're all left with the tab, that tab being the enormous amount of greenhouse gases it takes to lift even a gram of matter into space. Maybe there will be one day in the far future when we've reversed climate change and reached an equilibrium, we can safely bury people on the moon, but let's not start it now.
This is inaccurate because if you take the high end of the Falcon 9 per-launch emissions estimates discussed in this thread (about 28k metric tons equivalent of CO2) and divide by the payload size (about 17 metric tons) then each gram of matter lifted into space would be taking about 1.5 kilograms of CO2-equivalent emissions, which is a small amount instead of an enormous amount.