Does your card have proper DRM support (the linux subsystem for managing video buffers)? That’s what wayland builds upon (instead of patching the xorg binary with some proprietary extension).
They have since started supporting the linux kernel and implemented its APIs more or less. I don’t own any nvidia card, so can’t really speak from first-hand experience though.