If you install yabai (https://github.com/koekeishiya/yabai) it has a feature that can completely disable spaces switching animations - but it does require partially disabling SIP (worth it for yabai, IMO).
If you change spaces using the keyboard shortcuts like Ctrl+1,2 etc. (they might not be set to that by default.. it's 'Switch to Desktop 1' etc in the settings), then there is still a shorter animation, and there is no input delay when switching.