If you leave things alone for a while, many non-renewable resources are surprisingly renewable on medium timescales. Forests will typically regrow, fishery stocks will come back.
This is the same as agreeing with the premise for opposing unconstrained population expansion. "Leaving things alone for a while" is not consistent with continued large population increase we've seen in last hundred years.