Been there, done that. Then dropped dark mode entirely. Strong filtering of blue light (use redshift or whatever your OS provides) beats dark theme IMHO, without the downsides.
I default to light mode these days. Astigmatism does not goes well with small, bright details against a dark background. Then I can turn the brightness of the display way down.