[singhrac]

I'm also largely skeptical of the claim that Google is going to completely drop the ball here, but this is classic Innovator's Dilemma - sometimes a business can't effectively segment their existing customers enough to introduce a higher initial cost but ultimately better technology.

I think a Google Search Premium that cost $50/month would go over pretty poorly with Google's existing customer base (advertisers), but a startup can experiment with the business model with the right early adopters (e.g. Neeva).

[janalsncm]

I mean, they’re already using LLMs. Namely, BERT.

[freediver]

There is no exact definition but BERT would probably just be a LM, not a "large" LM.

[janalsncm]

Is the exact definition important? The point is, they developed a thing and integrated into their core product. BERT allows them to handle conversational queries much better than before.

[freediver]

I think it does, because LLMs allow things that LMs like BERT don't - like answering complex question on their own etc which is being discussed in the context of this thread.