Optimizing for efficiency isn't a bad thing. The real problem is the larger economic feedback loop based around keeping the number of hours worked the same. So the efficiency gains are effectively lost, and the average worker is left still depending on the ever-optimized structure rather than being able to accumulate enough wealth to escape it and create new structures.