[dismalaf]

> I can only hope this data is being incorporated in some way that makes hallucinations less likely.

The key word is "real-time". LLMs can't be trained in realtime, so it's obviously going to call an API that pulls up and reads from AP news, just like their search engine.

[notatoad]

i don't think you can assume that - "real time" in this context could just mean they feed every article into their training system as soon as it's published.

[iamjackg]

That seems more unlikely to me -- training is not free and takes a long time, so it would not result in "[enhancing] the usefulness of results displayed in the Gemini app" and it being "particularly helpful to our users looking for up-to-date information."

Fine-tuning, which is cheaper and faster, has been proven to not be a good solution to "teach" models new facts.

I think what's most likely here is that Gemini will have access to a form of RAG based on a database of AP articles that gets updated in real-time as new articles are published.

[CuriouslyC]

They can't deploy that fast and people want to pin model version so it's not feasible anyhow.

[summerlight]

If there's any company who can afford "real-time LLM training" at this moment, I'm 100% sure they will win this AI race since they probably have at least ~10x compute compared to competitors. Of course, no one can do that right now.

[dismalaf]

Have you ever asked an LLM what time it is? It takes months to train them...

[tomrod]

But it can be trained to access basic, limited APIs to get current information.

[dismalaf]

Yes, which is literally what I suggested it does in my original comment.

[tomrod]

<3 thanks for calling out what I missed. I didn't realize you were supporting an earlier comment on the chain.