[simpaticoder]

We humans tend to chauvinism in all things (e.g. we're special, the center of the Universe, God made the universe for us, etc), no less when it comes to judging intelligence. The original story about thinking meat was written to help us out of our chauvinism; this derived story was written about weights for the same reason. Which is quite valid.

The actual counterpoint is demonstrated in _Blindsight_ Peter Watts. He makes a strong (and rather terrifyingly strong) point that intelligence is not consciousness.

https://en.wikipedia.org/wiki/Blindsight_(Watts_novel)

[mjg2]

I cannot tell if you are asserting my comment is chauvinistic with your use of "we." If that is so: that's a poor counter to my point or assessment of my stance because it assumes I'm making a baseless argument as a "proud human."

My original comment (roughly "there's no intelligence in this article, nor sentience in LLMs") is in response to the blog post's buried lede (that the cumulative activity of LLMs has accrued to a weight of "AGI is around the corner" or "there is artificial consciousness in this matrix").

To be clear, I'm not saying LLMs are useless or a wrong direction in development of "AI," but rather it's the Fool's Gold for the path towards AGI, the pursuit of the academic field of Artificial Intelligence research. A research that I've been abreast of for years before this new age of language models that has made everyone with a keyboard an arm chair expert.

Also, thank you for the book recommendation, it's on my list! :)

[simpaticoder]

I read your comment as criticizing the OP's story as pointless and unoriginal. My comment elucidated the point of the original story, and what I think is the point of the second story.

[mjg2]

Roger that, thank you. w/r/g your recapitulation of my point: yes, the story is unoriginal and pointless, and the HN community seems to eat it up-- isn't that odd.

So I still disagree with your elucidated point (as you end with "which is valid"): the OP author is using prior art fiction to bolster their opinion of LLM-based software tools as being a possible vector of sentience, not to disarm our chauvinism like the original author intended. If OP wanted to make that point, they could have written a critical essay instead of farming out their thoughts as tokens.

But still, I look forward to reading the book you suggested to understand and appreciate your perspective more.

[simpaticoder]

The point is valid regardless of whether you judge LLM to be sentient or not, because the point is to say "don't let your prejudice about substrate bias your decision". Or in other words, if you're going to weigh something don't tip the scale. This is good advice whatever the outcome of the measurement.

Blindsight is a remarkable book - I hope you enjoy it!

[mjg2]

Ah I see now that I am in agreement with you, thank you for being a patient interlocutor. I do not discard and rule out the possibility of a different substrate being the well-spring from which sentience emerges.

Plainly, based on the current ground trodded and the trajectory laid out by the frontier AI labs, I do not have concrete evidence/proof of sentience having emerged from LLM-based software tools as of June 4 2026 nor do I expect it to happen in the future based on my understanding and observations of this technology. I'm not excluding the possibility but wielding skepticism. I am open to being proven wrong with new discoveries.

Which is why (to return to my lashing of the dead horse) I don't see OP's post as worthwhile. Their post reiterates a point that is already valid (the prior art) with no new substantial discovery. Which is why "unoriginal and pointless" is apt, a novel idea was not presented; it's just some vain virtue signaling.

[gibspaulding]

Wait, did I grossly misunderstand Blindsight?? I definitely thought that the aliens were 100% conscious (or at least elements of some conscious entity) and that the humans interpretation of their interactions with the Rorschach were supposed to be read as a blot test (through a rather heavy handed metaphor) demonstrating that basically the humans were the monsters and were twisting logic into letting them justify destroying the scary alien ship.

[simpaticoder]

That's a very interesting reading! It's been a while since I read it, but IIRC Watts explicitly talks about the matter of intelligence vs consciousness at length and Rorschach's lack of consciousness is essentially proven at some point by the linguist. The distinction is driven home subjectively, personally by the viewpoint character. Your reading adds a rather diabolical twist! I don't think it works though since Rorschach was clearly a tiny part of a much larger, more powerful entity and the humans are clearly doomed. I'm not sure it serves a narrative purpose to have humans be a weak, evil civilization destroyed as a side-effect of a good, strong civilization's actions. I read it as a (hopeless) conflict between non-conscious, infinitely strong aliens vs conscious weak humans and post-humans. I mean it took extreme, heroic effort to damage what is probably a tiny appendage of a much larger civilization/organism, and you lose the emotional resonance if humans are the baddies.

[gibspaulding]

I think you’re right. I read the Wikipedia page after to refresh my memory on the synopsis and I’d definitely forgotten a lot.

I think I mostly latched onto the ship being called Rorschach and the humans immediately proceeding to torture its inhabitants. That felt very relevant to me and sort of overshadowed the actual consciousness question.

[overgard]

I don't think skepticism should be called chauvinism. I imagine that artificial consciousness could be made. But I don't think this is it.

Also I don't see why intelligence not being consciousness is scary? My cats are very conscious as far as I can tell, but not particularly intelligent. I think LLM's exhibit some contextual intelligence without there being any particular reason to believe they're conscious other than woo psuedoscience.

[runarberg]

You underestimate the intelligence of your cat. Or rather you measure intelligence with an extreme human bias. What you consider intelligent behavior your cat may consider weird, and what your cat considers intelligent behavior is something you will never consider.

That said, I don’t think it is useful for philosophy nor science to consider intelligence to be the same thing as consciousness. In fact I would go even further and claim that intelligence is not a useful construct, neither for philosophy nor for science. Consciousness, on the other hand, I think is useful for philosophy, but not (as of now) for science.