| I know that articles like this, and the broader dialog, doesn't go too in-depth on how these things work. The phrase, "one agent understand marketing econometrics" from the article makes me wonder what exactly they mean. This could be anything from "we put a prompt in front of chat-gpt that says 'you are an expert in marketing econometrics'" to "we built a model trained exclusively on marketing econometrics material" No matter what they actually did, the agent (assuming its an LLM) doesn't understand marketing econometrics, instead it's tuned to produce output tokens that I suppose make more sense when the topic is marketing econometrics. I'm not an LLM detractor, but I find the kind of thinking that's become prevalent to be so squishy. Humans are great anthropomorphizers and it seems today that no one is attempting to hit the brakes on that instinct. The models don't understand anything, in the way that we commonly use the term understand. It seems we've confused ourselves because the box that doesn't understand marketing econometrics can produce marketing econometrics analysis and when we ask it why it came to such and such conclusion it can produce convincing explanations. As an aside, I also feel like I've heard this for 30 years about marketing. Marketing is everywhere, the surveillance economy tracks our every move in more and more invasive ways every day, and still companies go "Aw shucks, we just can't make sense of this data." It reminds me of a time when I was working for Abercrombie and Fitch and there was this massive report our team was partially responsible for generating. 500+ pages, generated everyday, sent to a high speed printer from a COBOL job every morning at 5am so that 10-15 copies could be made for the executives. It had *all the data* and each executive had their own little ritual around which bits they thought were important. Throughout my career as an engineer I've been asked to get more data, more data, more data. Process the data, analyze the data, create some graphs and tables and help people understand the data. One thing I've realized is that the people demanding all this data, all this insight, all this analysis, are unlikely to actually need it or use it when available. They are tasked with making decisions, and decisions are scary because you can make the wrong one. They would love to not make the decision and maybe you can find enough data that the choices get cut down to just one. Then if it ends up wrong they aren't to blame, the data made them make that decision. So all of this surveillance, all of this analysis, all of this data is likely just to make some person feel a bit more comfortable about making a decision. |