I was convinced to try and decided that I like using Caps Lock as a left-hand Backspace myself. Nice to have one on each side, and that one is a much more convenient reach for your pinky.
That's a great idea! You've inspired me to try setting it to Delete, because it's a bit awkward to delete characters after the caret on Mac right now (FN + Delete is the only way I know how)