Finland is one of the worst places in the world for renewables. This means that any industry using significant amounts of energy is going to move away from Finland, once fossil fuels are no longer used.
The viability of renewables depends more on population density than location. There are always some natural processes you can take advantage of to generate power. And if the density is low enough, like in Finland but probably not in the US, existing hydro should be enough to cover most energy storage needs.
Most of the electricity in Finland is not produced by using fossil fuels. For example during year 2020 14 % of the electricity in Finland was produced by fossil fuels.
I was talking about energy intensive industries, not electricity production. If Finland has to compete with other countries that have cheap renewables, it will lose these industries. As an example of something like that today, look at primary aluminum production.