See also Seveneves[1], where a similar evacuation does indeed have some downsides. It's also a theme in one of my favorite Ted Chiang stories, "Mono no Aware"[2].
Seveneves and the Dark Forest series are literally the last two (sets of) books I read and they are so wonderful. The last book in the Dark Forest series in particular has some of the most mind-blowing concepts I've encountered in SciFi.