I am currently building something similar but only for Codex app (not terminal) https://remotecodex.app An e2e encrypted link between the Codex app and the phone.