Hacker News new | ask | show | jobs
by lunixbochs 1851 days ago
First - online learning is generally not necessary with my Conformer model (which is generally >5x better at not making errors than the current public model). It's also quite good at accents. My overall goal is to ship speech models so good you won't actually wish for model training.

I view fully automatic online training as a sort of anti-pattern - Dragon does that and it will randomly forget entire words. Talon may eventually have some kind of process for self-serve model training. I do have some plans for what that might look like.

Even without automatic model training there's already a feature to automatically create a sort of "personal dataset" as you use Talon, which you can use to train speech models (Talon or otherwise) down the line, or even send me to improve the main model.

1 comments

I gave it another try - `events.tail()` was useful to know what Talon was trying to do, but it is very busy. However, I came across https://talon.wiki/getting_started - not sure if this is an official Talon site, but I found it to be a really helpful resource, certainly moreso than https://talonvoice.com/docs. From here I found `command history`, which shows exactly what commands Talon is hearing - great!

I also found that the microphone makes a big difference - with my Plantronics Voyager Legend bluetooth headset, it was basically unusable, misunderstanding almost everything I said. But if I used a cheap Logitech USB headset that I've had for a decade, alphabet accuracy was good.

Something else is that it does seem to struggle a bit with my accent. For example, with the alphabet I would say "air", and 75% of the time it would hear `oh`/`near` - however, if I said "air" in an American accent, it heard `air` correctly every time.

Will be interesting to see how your new engine fairs when it's released.

I did tell you to try "command history" on the same line I told you about events.tail(). You can pass a string argument to events.tail() to filter it (which works even better in the beta/next version). I'm considering modifying the events.tail() behavior to filter / differentiate human-triggered events vs machine triggered events, which should clean up the default output a bit. One of the things I'm strongly considering for the next release is a "subtitle" feature that's enabled by default to tell you what is recognized.

The wiki is something I currently try to introduce folks to later in the process, because it's unofficial and historically has had assumptions, inaccuracies, or very outdated information that caused me additional stress/support load. I know the community has been working on improving that.

Bluetooth mics are almost universally worse than cheap wired mics, due to bandwidth/power/compression constraints. If you make a file user/settings.talon containing "settings(): speech.record_all = 1", Talon will record successful utterances to recordings/ adjacent to user/, and you can compare what the mic sounds like to Talon. It's also very likely the mic works better with Conformer.

The alphabet is pretty easy to change. Check out the top of keys.py. There are some words that aren't really the engine's fault when it comes to accent, and some pairs like air/near are more of a configuration issue if your accent doesn't differentiate them.

I'm hoping to release v0.2 with Conformer sometime around July 1