You can. The Vision Pro supports a primary user that retains settings/user account/AppleID and a secondary user with gets a “guest” account that resets.
Based on how these work on many existing VR headsets including Quest 2, these are just insets that you can just take out. Probably held magnetically as well.