[sdesol]

Well if you ask GPT-4o the following:

Give me keywords to search for based on this sentence "international relations about the country with the capital city of Ankara"

You get the following:

- Turkey international relations - Ankara diplomacy - Turkey foreign policy - Turkey global partnerships - Turkey international politics - Turkey geopolitical strategy - Turkey foreign affairs - Turkey global relations - Turkey NATO relations (if relevant to your topic) - Ankara as a diplomatic hub

So it is not unsurprising that the same link was returned

[enisberk]

This is a demo from a small startup dedicated to enhancing government transparency, which I greatly appreciate. As a result, my expectations are aligned with this goal, and I refer to this as a smoke test.

Achieving accuracy with RAG and LLMs is a challenging task that requires balancing precision and recall. For instance, when you type "Ankara" into GPT-4o, it provides information about Turkey. However, searching "Ankara" in their product does not yield articles related to Turkey.

[sdesol]

> Achieving accuracy with RAG and LLMs is a challenging task that requires balancing precision and recall

The challenge is domain knowledge and not tech in my opinion. There are dozens if not hundreds of companies providing RAG and LLM, but the challenge is, like you pointed out, what should you do if you encounter something like "Ankara".

For BestBuy, this might not mean much, unless there is a BestBuy in Turkey. For a government related site, cities and geography is important, so trying to extract additional meaning from Ankara is probably important.