FWIW, I am not opposed to GMOs broadly. But I am opposed to GMOs for the purpose of enabling more industrialization in agriculture. I don't see, e.g., red grapefruits as bad, even though they used an early form of genetic engineering (seeds were exposed to radiation in hopes of creating random mutations.)
I think I see your viewpoint and agree with it. It isn't a matter of "do we modify or not" but rather "how, when, and for what purpose? who benefits? does this damage the land or species lineage? etc"