Statistics is a very interesting subject, and it is a distinct subject from mathematics proper. Here (in what is becoming a FAQ post for HN) are two favorite recommendations for free Web-based resources on what statistics is as a discipline, both of which recommend good textbooks for follow-up study:
"Advice to Mathematics Teachers on Evaluating Introductory Statistics Textbooks" by Robert W. Hayden