Many people who know way more math / probability than me have recommended this book a bunch of times: Probability Theory: The Logic of Science by E.T. Jaynes