[falcor84]

Well, for better or worse, markets are becoming increasingly dominated by "non-biological utility maximizers" - mostly hft bots, but now also llm-based reasoning agents.

[dash2]

Actually there’s a literature on whether llms have the standard cognitive biases, via cultural inheritance….

[HPsquared]

They're not necessarily maximising utility, just the number on the screen.

[pixl97]

The utility monster has decided that numbers are more useful than products usable by humans.

[fc417fc802]

"Ahkchually the paperclip maximizer isn't maximizing [human] utility, just a dumb metric" isn't a particularly useful observation to make in the context of the world being gradually consumed by an army of nanobots.

[HPsquared]

I'm thinking of an earlier time when computers ran on "facts and logic" and you could probably stop the machine by giving it a logical conundrum. Vibes-based systems are a lot more resistant to this, but can still be distracted.