Although it hasn't gotten better from my perspective. But until I searched for this, I was totally unaware they've provided an easy way to train your own model for the wakeword! https://mycroft-ai.gitbook.io/docs/using-mycroft-ai/customiz...
I will have to try that and if I remember I'll update here if it improves my situation in a few days