If you want to explore this kind of thing, you can mount a camera on your HMD (Vive's is crippled), use a WebVR stack (simple), track objects using visual markers and javascript tracking libraries (jsartoolkit5 and/or tracking.js), and do selective camera pass-through AR. It's crufty, but not hard.
EDIT: You can simply use the Vive's camera, with tracking.js color tracking, especially with a small minDimension (number of pixels) threshold. Yellow is good.