Y
Hacker News
new
|
ask
|
show
|
jobs
by
maltelandwehr
260 days ago
Regular Cloudflare + heavy caching should solve all crawling problems, no?
For most bot visits, there should not be a single database request.