Your extension should “just work”. And yes, we have a self-hosted environment solution that you can use to test out your extension in the web, and it’s entirely free: https://aka.ms/vso-docs/vscode/self-hosted.
If you run into trouble, we've also expanded the Remote Development extension guide in VS Code documentation to cover Visual Studio Online as well: https://aka.ms/vso-docs/developing-extensions