[graeme]

If people repeatedly have a misunderstanding about or expectation of your business you need to address it though. An llm hallucination is based on widespread norms in training data and it is at least worth asking "would this be a good idea?"

[carlosjobim]

An LLM will say that you sell your competitors products or that your farm sells freshly harvested strawberries in the middle of winter. There are no limits to what kind of lies an LLM will invent, and a business owner would be a fool to feel responsible for anything an LLM has told people about their business or products.

The best LLMs available right in this moment will lie without remorse about bus schedules and airplane departure times. How in the world are businesses supposed to take responsibility for that?

Likewise if I have a neighbour who is a notorious liar tell me I can find a piece of equipment in a certain hardware store, should I be mad at the store owner when I don't find it there, or should I maybe be mad at my neighbour – the notorious liar?

[graeme]

>Likewise if I have a neighbour who is a notorious liar tell me I can find a piece of equipment in a certain hardware store, should I be mad at the store owner when I don't find it there, or should I maybe be mad at my neighbour – the notorious liar?

If you are a store own, AND

1. People repeatedly coming in to your shop asking to buy something, AND

2. It is similar to the kinds of things you sell, from the suppliers you usually get supplies from, AND

3. You don't sell it

Then it sounds like your neighbour the notorious liar is doing profitable marketing for your business and sending you leads which you could profitably sell to, if you sold the item.

If there's a single customer who arrives via hallucination, ignore it. If there's a stream of them, why would you not serve them if you can profit by doing so?

There are obviously instances you'd ignore and you seem to be focussing on those rather than what OP was obviously talking about, repeat instances of sensible ideas

[carlosjobim]

I guarantee that most businesses have nothing against stocking or offering items that people come in and ask them for - but it has to be possible also. If you're asking for a Polish sausage in a hardware store because your neighbour sent you, then they probably don't have the licenses to sell food items, and probably their profit margin is higher selling hardware than selling sausages so they have no reason to start offering them.

There's usually a good reason why a business might not offer something that people think they should offer. Usually it is that they can't be profitable enough at a price point which customers will accept.

[smaudet]

I think the issue here would be that we don't really know just how widespread, nor the impact of the issue.

Ok, sure, maybe this feature was worth having?

But if some people start sending bad requests your way because they can't or only program poorly, it doesn't make sense to potentially degrade the service for your successful paying customers...