most people hate their jobs; some people are just lucky enough that their jobs compensate them well enough for the emotional labor as well as the physical labor. also i have worked other SWE jobs (as already mentioned) and i've hated them all.
Would being a baker make you happy? Because this conversation makes me feel like you are one of those guys who is like "if I was a baker I will join the permanent underclass which means I cannot be happy doing that either"
I don't understand why you're asking these questions at all - my happiness is not the subject here? Throughout I'm merely maintaining that swe sucks no matter where you go despite people thinking the grass is somehow greener in ML.