My experience is significantly different. I find that developers who use Vim and Emacs are generally more experienced and have chosen their tools with care. They understand the importance of simplicity in design. They don't pull in large libraries arbitrarily. They commonly write more efficient code to provide the same functionality, with less bloat.
Your mileage may vary, but the best developers I've personally worked with all use Vim or Emacs.
I didn't downvote you but I'd honestly like to ask why you think that integrating large libraries would speed you up instead of increasing the bloat of the code base?
Just the reality of the projects. Just doing something simple like database access from a java project, or matrix math in a python projects, you're going to use a library.
Your mileage may vary, but the best developers I've personally worked with all use Vim or Emacs.