Because if just touching fruit is going to hurt us, surely handling it is far worse? Why aren't we seeing obvious health problems from the plant workers etc? If it was that toxic, we'd know.
Not every package and contents within are the same. The plastic containers for prepackaged produce are much lower on my concern list than say Coke and Red Bull type drinks. If you've ever seen what those can do to concrete, you'd really question what it's doing to the plastic linings in the bottles/cans. Someone also mentioned alcohol reacting with the plastics. All of those gas stations where they have pallets of soft drinks just sitting outside in direct sunlight also gives me pause on how lackadaisical we've become. The '91 Gulf War gave us lots of insights into storing Diet Coke in the sun in a desert can cause "unexpected" reactions to the liquid.
Throwing your hands up and running around like a headless chicken is probably an over reaction, but rolling your eyes and sticking your head in the ground to ignore it is also equally not good.
If you care about future generations you should care about anything we create that's harmful and that doesn't break down naturally.