[camdenreslink]

If you are using an LLM to actually fetch that data, combine it, and present it to you in an ad hoc way (like you run the same prompt every month or something), I wouldn't trust that at all. It still hallucinates, invents things and takes short cuts too often.

If you are using an LLM to create an application to grab data from heterogeneous sources, combine it and present it, that is much better, but could also basically be the excel spreadsheet they are describing.

[Daishiman]

Your knowledge of LLMs is outdated by at least a year. For the past three months at least my team has been one-shotting complex SQL queries that are as semantically correct as your ability to describe them.

And why do you diminish the skill of good data wrangling as if it weren’t the most valuable skill in the vast majority of computer programming jobs? Your cynicism doesn’t correspond with the current ground truth in LLM usage.

[camdenreslink]

Well, that is still having the LLM write code which is more like my second scenario. I use SOTA LLMs for coding literally every day. I don't think my knowledge is "outdated by at least a year".