[ericmcer]

arent they complete trash as a database? "Show me people who have googled 'Homemade Bomb' in the last 30 days". For returning bulk data in a sane format it is terrible.

If their job was to process incoming data into a structured form I could see them being useful, but holy cow it will be expensive to in realtime run all the garbage they pick up via surveillance through an AI.

[andai]

Most LLMs I use would respond to this by writing a Python program to run the query.

[moomoo11]

And that program would be written different each time and sometimes fail.

[sshine]

...and the LLM, given an agentic loop, would ingest its own error message and correct itself...

...and eventually it'd persist some knowledge in a context window to not make that mistake for a while...

...and then it'd forget and make the same mistake again...

[moomoo11]

exactly