Having to hover each time is a little unwieldy. Patterns [0] could be helpful? In this instance it might be neat to have stripes in the cardinal/diagonal directions which can combine into crosshatch, though after 4 colours it would get crowded to represent.
[0] Something similar to https://images.wsj.net/im-194691 for lighter-shade-on-darker shade.