Should you not then take responsibility for the additional sick leave taken by your colleagues as a result of you exposing them to your infectious diseases?
It's quite possible that the total sick leave you've caused is substantially higher than it would have been had you simply stayed home when ill.
I was down with Epstein-Barr/mononucleosis for 12-14 days in 2004, and then I stayed home (home from PhD studies).