Someone who is currently a professor at both Harvard and Berkeley gave an interview on NPR about recreational drugs, an area which they specialize in. Caffeine was brought up as drug that people generally consider acceptable but how it has side effects worse than some drugs which are illegal. One of them being that the half life for caffeine prevents you from getting a good night's sleep, which, if done over a lifetime, will contribute to cognitive decline.