Nvidia doesn't have a monopoly on GEMM and GEMV. There will be dozens of hardware vendors. It is TSMC that should be the most valuable company in the world.
Certainly one of the most valuable, but I would still say TSMC as there are lots of other steps in the production besides photolithography (etching, ion implantation, vapor deposition, packing, ...).