If your answer requires clustering and assembling disparate facts strewn about on the internet or company data / documents and reasoning over them, then LLMs can help that. Atleast that's what I did when I used to answer questions on stackoverflow.
My point was before AI, when I used to answer stackoverflow questions out of curiosity, I used to manually search around on internet to properly answer the question. This is exactly the process LLMs help with.