Hacker News new | ask | show | jobs
by maltelandwehr 260 days ago
Regular Cloudflare + heavy caching should solve all crawling problems, no?

For most bot visits, there should not be a single database request.