Those billions are relative to the amount of money they made though. A crappy analogy is a bank robber who steals a million dollars from 10 banks, gets caught at the last, and has to pay back 2 million dollars.
It's almost a year's worth of profit. Do you have reason to believe that their income obtained by fraud is significantly more than the fines they paid? Goldman has plenty of other businesses.