I'd be surprised if that's "most workers". Some workers sure, especially those who already have some wealth like an already paid for house and can afford to be picky with their careers, but most workers who do not, are chasing wealth building and financial security first before being picky about the ethics and other aspects of their career.
Perhaps I worded it a bit poorly - I don't think most workers have a purely non-financial agenda. But most workers have multiple agendas for working, the financial agenda probably being the strongest.
But it's not a purely transactional agreement like you make it out to be.