Yes, I've always disliked this saying. People have agency. They can always refuse to play the game (and that is precisely what many great people chose to do).
Oh you're in the game. Your choice is whether to win the game or lose the game. Also if you lose the game you die. It's like Jumanji. Pretending the tiger isn't real is not a viable option.