Nowadays, the top Google result is probably LLM-generated blog-spam of lower-quality than whatever chatbot your company is paying for.
Back when most Google results were authentic web-pages, something like "here's a web page that I think solves your problem" was a fairly useful reply from a coworker.
AI answers may or may not be completely hallucinated, and often the people copy/pasting them didn't even read them.