Neither Wayout nor Capture the flag, it's older prettier brother uses raycasting.
Sources are out and there's some more info in AtariAge forums where some maniacs ripped it apart and even made it faster using more current tricks.
https://atariage.com/forums/topic/320414-smooth-3d-movement-...