Hacker News new | ask | show | jobs
by caprock 1374 days ago
This is pretty neat! It's great to see relatively recent advancements in machine learning, put to use for child education.

A few questions for @Cherian:

1. I see the ASR usage, but where does computer vision come into play?

2. Are you training and/or fine tuning asr models to deal with the speech characteristics of children and new speakers?

3. Is the asr all cloud side, or do you have it running locally in some fashion?

3 comments

Reading Adventure uses computer vision to help kids read through the books. The vision tech is used in combination with a “wand” to figure out the pages, words, and letters the kid is pointing to.
heyo,

2. The model is primarily focused around kids, with focus on repeated words and partial words

3. ASR is local to device. We are using a focused model per book

Thanks for all the answers and insight!