In summary: Using logistic regression actually improves accuracy, but also performance during both runtime and during training.
Do 5-fold cross validation, maybe stratified.
Do 5-fold cross validation, maybe stratified.