It's very natural to use j and k. When you touch type, "j" is your right index home base (I assume you know it but that's why there's a physical marker on "j" and "f").
I mean from a layout perspective. hjkl is in one line, whereas the arrows are not in one line, with "up" one line above "down".
That's a muscle memory I cannot fight yet.