[andrepd]

You can use it without leaving insert mode.

[wildmusings]

Huh? In insert mode, the backspace does what it does in all editors. We're referring to the behavior in normal mode, where backspace is equivalent (I think?) to 'h', or left arrow in most editors.