If you have no soft skills or business savy, you’re getting screwed either way, regardless of tech sector vs Wall Street. There are politics in every org.
There has always been a perception amoung many techies and ents that "wall street" represented the old, entrenched, 'rent-seeking' capitolism, while SV style was 'changing the world', dispuptive, and somehow more egalitarian. It seems to mirror the political divide somewhat, with many younger more visionary types going for broke out west, and the more risk adverse finding a reliable income in finance. Its a matter of perspective as much as philosophy.
'Silicon Valley' and 'Wall Street' have become sort of extreme synecdoches that carry tons of baggage when used. While often useful, I find they are becoming increasingly disingenuous in regards to current state or at least in regards to the way things are changing for the better (in contrast to the negative meanings implied when one of these terms are used as a derogative).
It's hilarious in a way because every starter-upper would like to see their company listed at the stock exchange at some point. IPOs are so much more gratifying that acqui-hires.
Wall Street is all about money, pursuit of money as a form of power, manipulation of money as an intellectual game abstracted away from its effects on the real world - or so goes the image of "Wall Street" as it exists in terms of having a bias against working there, or in businesses which have a similar mindset.
Personally, it sounds unbearable, since money is just about the most boring topic I can imagine, done to death for centuries already; I'd rather watch paint dry.
That's one model, sure, but it is a simple model, it has been explored quite thoroughly over the centuries, and it seems to inevitably bring exploitation and tedium. Life is short and I have no desire to spend mine going over that well-trod terrain; I'd rather look for ways of using technology to disintermediate, to detransactionalize, to find better ways of making collective decisions and coordinating group effort which do not involve money or accounting and are therefore resistant to control and exploitation by gatekeeping institutions.
Disclosure: Left tech for Wall Street