If you are just getting started, you can read this tutorial I wrote for SitePoint:
http://www.sitepoint.com/set-jekyll-blog-5-minutes-poole/