What stops a record company from including a clause assigning any NFTs (and/or the revenue therefrom) created by the artist during the contract term to them?
Nothing. Just like nothing stopped Taylor Swift from rerecording her entire library to license her music herself. If artists sign their NFT rights away, that's on them.