Hacker News new | ask | show | jobs
by adi_kurian 203 days ago
https://www.google.com/search?gs_lcrp=EgZjaHJvbWUyBggAEEUYOT...

I don't think this is an LLM bug. I think this is an implementation bug. The model thinks it is 2024 due to training cutoff date, though it is "connected to Search", so conflicting information is getting in the prompt.

Answer when connected to search —

https://www.google.com/search?gs_lcrp=EgZjaHJvbWUyBggAEEUYOT...

Multi pass + search = correct answer

https://www.google.com/search?gs_lcrp=EgZjaHJvbWUyBggAEEUYOT...

1 comments

Even since the very early versions of Sydney and ChatGPT their system prompt has started with the current date/time (and username, user geolocation etc), it seems odd they'd leave it off here.