Every and any medical procedure has risk attached, and consent was - until recently - considered a given for any adult of sound mind, which is to say that any concern about a medical procedure is always valid, at its base, as is the refusal to have one.
Yes, there were negative side effects reported for athletes. For tennis, there's a case of French player Jeremy Chardy who had to stop playing for the season after vaccine reaction: