Setting aside the question of who holds it, is it an inconsistent position? If a broadening of fair use is necessary for developing large language models, it's perfectly consistent to argue it should also extend to artists/archivists/derivative works in general, otherwise you're staking out the position that pirating one book is wrong but downloading Books3 is fine