It's not the speculation and scams that are an environmental cost, it's the fact that the Bitcoin network uses more energy than a medium-sized country.
driving up the price of bitcoin increases the motivation to run even more bitcoin miners which use more and more electricity. Depending on where it's generated that can come at the cost of the environment.