semiconductor manufacturing is highly skilled - ie the folks over seas were already well paid. It was a lot more about approvals, permissions, etc, than wages with this manufacturing area. It shouldn't have a huge impact.
Although, in the US semiconductor companies have to compete for technical people against companies doing the apparently really economically productive stuff—coming up with ad algorithms and playing Wallstreet shell games.