Hacker News new | ask | show | jobs
by bckygldstn 852 days ago
requests-cache [0] is an easy way to do this if using the requests package in python. You can patch requests with

  import requests_cache
  requests_cache.install_cache('dog_breed_scraping')
and responses will be stored into a local sqlite file.

[0] https://requests-cache.readthedocs.io/en/stable/