Horseman is an endlessly configurable crawler powered by JavaScript snippets. I've been building it in my spare time and the latest update is a big one!
With the latest update (v0.3) GPT capabilities have been added allowing you to crawl the web with GPT and combine page content with prompts (requires your own OpenAI API key).
Don't know JS? An AI helper has been added to assist with creating your own snippets.