Hacker News new | ask | show | jobs
Crawl4AI (docs.crawl4ai.com)
2 points by bjornroberg 94 days ago
1 comments

Promising foundation if you’re willing to own the policy layer + quality gates. Also worth calling out the boring production bits: robots/ToS, rate limiting, bot mitigation, login/session handling, and not accidentally hoovering up PII.