@acqq: Shameless plug. This doesn't seem to have speech. However, I've tried to build a text to speech synthesizer in www.voiceclonr.com. Appreciate if you could try and leave feedback.
So much developer rage in that Status :) On the HMM stuff, it was pretty much the baseline code from the link. The things I recall experimenting were more about getting it done faster (threading some training phases, different gcc options during synthesis etc).
https://connect.microsoft.com/VisualStudio/feedback/details/...
"System.Speech has a memory leak - by eoghanoh
Status: Closed as Won't Fix"
I see your work is based on http://hts.sp.nitech.ac.jp/ Can you tell us what are your changes?
Edit: I see HN already commented your work:
https://news.ycombinator.com/item?id=9812734