|
|
|
|
|
by ComputerGuru
778 days ago
|
|
Playing around with the UI, I cannot see where that depth would be set. Is it not a per-datasource variable? Is the "scrape linked pages" configured to be "sandboxed" within a url hierarchy (so adding example.com/foo/ would add all linked pages that are also under example.com/foo/) or not (so it would also include linked pages to other domains or subfolders)? |
|