I use ex maybe once a year, when $TERM is screwed up or latency is terrible, but to me removing it is a red flag that says the NeoVim folks don't really grok vi.
This was my initial take, but all that's really being removed is the ability to switch between ex mode and visual mode - to which my objection is substantially weaker (to the point that code clarity and separation of concerns are probably more important).