If you're willing to try something a little bit different, Windows also has a single-click to open mode ('View->Options->Change folder and search options' in Win 11). To only select, you point and hover for a moment.
I wish it would let do single click open without hover to select. It's just too easy to mess up your selection if you are not careful where you park your cursor for even a split second.
KDE's Dolphin is much better here, can be set to single click open with drag selection box or click + icon to select.
FWIW, you can configure the minimum distance for a mouse move to count as a drag. The default was adequate for 640x480, but maybe should have been increased.
For others: I was curious how to do this, so if you put “change windows drag drop sensitivity” into your search engine of choice you’ll find a tutorial for which registry settings to change.
The default is 4 pixels, which I’m inclined to agree is low these days.
To be more precise, it’s the registry settings HKCU\Control Panel\Desktop\DragWidth and DragHeight. You can also use a tool like Winaero Tweaker to adjust the values.