I've actually already thought about that a bit! Apparently there's a hacker still inside me with a penchant for self-torture that really wants to see how far I can take that interface!
Technically you can do text input in the app already, and I believe they have an SDK that allows you to send your own info to the assistant and get responses of some kind. I'm honestly not sure about that, but i'm curious to see if there is something there I can work with. (and if the pricing model of it follows other google APIs, their "free" tier is probably more than enough to handle a single user, and each hacker-oriented "user" could just setup their own project which is how we also used the nest APIs).
I can then find a set of "commands" that I can feed to the "HID" (for lack of a better term), and create an extremely unofficial API around that...
Getting video back is going to be tough, but maybe with some extreme abuse of the chromecast APIs and that same HID->API interface I can get the google assistant to "cast" the camera feed to a faked chromecast and then pull the stream from there...
But as much as I like to daydream about that kind of stuff, i'm not going to do it. I don't need my google account shut down for abuse (imo probably rightfully so in that case, i'm sure that's against all kinds of terms!), and I don't want to support this decision if they do end up going through with this and don't provide an adequate replacement. So I'll probably just sell my Nest devices like I did previously with my Ring, and find another solution that won't pull the rug out from under me.
Technically you can do text input in the app already, and I believe they have an SDK that allows you to send your own info to the assistant and get responses of some kind. I'm honestly not sure about that, but i'm curious to see if there is something there I can work with. (and if the pricing model of it follows other google APIs, their "free" tier is probably more than enough to handle a single user, and each hacker-oriented "user" could just setup their own project which is how we also used the nest APIs).
I can then find a set of "commands" that I can feed to the "HID" (for lack of a better term), and create an extremely unofficial API around that...
Getting video back is going to be tough, but maybe with some extreme abuse of the chromecast APIs and that same HID->API interface I can get the google assistant to "cast" the camera feed to a faked chromecast and then pull the stream from there...
But as much as I like to daydream about that kind of stuff, i'm not going to do it. I don't need my google account shut down for abuse (imo probably rightfully so in that case, i'm sure that's against all kinds of terms!), and I don't want to support this decision if they do end up going through with this and don't provide an adequate replacement. So I'll probably just sell my Nest devices like I did previously with my Ring, and find another solution that won't pull the rug out from under me.