I've done the same with https://github.com/42wim/ssh-agentx/
Originally used to sign git commits with pgp in the sshagent, before ssh git commit signing was a thing.
Also works with windows as it uses https://github.com/buptczq/WinCryptSSHAgent that did the hard work to get it to talk with almost everything that exists in windows/wsl/putty etc.