So you mean, grow much less of it, and at greater cost? You know what else presents a risk of "reduced IQs, memory and attention deficits"? Malnutrition, the world's most potent inhibitor of intelligence.
Just a note, the world runs no risk of malnutrition even if we produce less food with cleaner forms of production. The world already produces more than enough for everyone. The problem is distribution, not production.
Essentially, yes. The "green revolution" is an illusion and its effects cannot be sustained. We need to gradually back down to a place where humans can grow enough food for themselves without also poisoning themselves and without exhausting soil fertility.
Or, having children. Natalism -- the positive and negative values constructed around having vs. not having children, the pressure put upon women to reproduce until they biologically can't anymore in most (really all) countries -- as a social reality is almost never thought about, much less discussed as potentially 'adjustable'.