[thalesfc]

Use selenium.py, it is by far the easiest and scalable solution out there. (believe me I have tried everything, beautiful soup, request.py, scrapy.py ... )

[pynerds]

Any tutorial to learn selenium.py

[thalesfc]

tutorials

http://thiagomarzagao.com/2013/11/17/webscraping-with-seleni...

videoblog

https://github.com/kjam/python-web-scraping-tutorial/blob/ma...

The first link is a straight following link, and the second one is a 30mimn video that goes through all available Python crawlers.

My recommendation: follow the first one if you are sure to use selenium or watch the second link to check all possibilities.