Worth noting the same bot-blocking that hits humans also blocks the
AI agents devs are building. Headed toward a web where only Google's
agent has free access.
Google has the Vertex AI Search API and Programmable Search Engine
already. If you want to access their data, you can pay for it like
everyone else does.