I have seen this type schedules from many startup folks, and I have tried to do something similar for myself.
Now, my family consists of me, wife and two kids. As I was kept being reminded, my poor wife keeps missing out some of my time. The winners of my time are my kids as I did not spent enough quality time with her.
However, my point is to make time for your significant other. Don't ever never forget that they are also part of your family!