[ruborcalor]

Yes I agree you want number of samples to be greater than number of features. This is why the number of features were reduced from over 400,000 to 25. After this reduction the number of features is less than the number of samples (~700).

Honestly I didn't prioritize hyperparameter tuning enough. I pretty much went with one of the first models I identified.

Could you elaborate on the idea of not capturing dependent features please?