This argument of yours is only part of an equilibrium. If it was the only force in play, that would be a strong argument against international trade. I guess there are some missing pieces here.
The more realistic argument is that you simply don't have the human capital necessary to build certain things in certain places. This can be addressed in large part by making immigration easier.