[mncharity]

Perhaps use hand tracking[1] to get candidate finger-tip positions, to simplify using the FTIR touch blobs for contact detection and precision position?

[1] https://viz.mediapipe.dev/demo/hand_tracking Web demo - run button is top right.

[oauea]

Or just add a few special purpose physical buttons to the side.