Web Crawler and Scraper for AI

Y	Hacker News new \| ask \| show \| jobs

	Web Crawler and Scraper for AI (spider.cloud)
	8 points by catskindleyou 549 days ago

2 comments

Very cool - and impressive speed!

How does it compare with headless browser services like https://browserless.io or https://browserbase.com ?

The chrome speed is also holding the bar high processing thousands of pages per second.

What's with web scraping tools rebranding as "web scraping for AI"? It has nothing to do with AI at all.

AI tools need to get the data in the proper formats while not letting the data layer being a bottleneck.