| I hate to be a downer but... > UK planning data is technically public. it's public, but still copyrighted by those who submitted it the councils also have database rights over their database, unless you've obtained explicit permission from them directly https://en.wikipedia.org/wiki/Database_right#United_Kingdom > I ended up writing several scrapers: a standard requests-based one, a Playwright-based one for councils that block anything that doesn't look like a real browser, and a curl_cffi one for TLS fingerprinting. so they're explicitly trying to stop you doing this, and ... you're openly admitting to bypassing their technical measures to try and stop you? have you heard of the Computer Misuse Act? I doubt the 240 councils are going to be happy once they find out you've done this, especially if you're selling it on for profit |