Physical work -> thinking work -> ???
Also, you forgot that many of the Luddites actually starved to death in the streets.