You somehow must be able to, as everyone I know has feeds full of that sort of thing, and I've never seen even one short or game on my youtube home page.
You can use the three dots to say "Not Interested" on the Shorts shelf but it only hides it for 30 days and then the insidious little worm comes right back.