Please do blog about the different aspects of implementation. Or at least post the link to the Github repo. This seems very interesting, and I'd love to hear more about how you did it.
Unfortunately, the github repo is private because I can't open source the whole algorithm right now. But I'll definitely do a write up in the next few days.