Hacker News new | ask | show | jobs
by AlexandrB 16 days ago
How can their internal representation represent "concepts" when the training data is all words? There's no possible experience of the world there. No input other than a bunch of imperfect labels we created for stuff.
2 comments

This is a wild argument.

If I use the word "semantic", do you have a concept of what it means?

If so, can you please share which of your senses have shaped the world experience that inform this concept? What have you smelled, tasted, caressed, that informed this concept outside of words?

If I make up the word "polysemantic", do you need to recall a personal experience of polyamory to understand it, or could you possibly use your concept of "poly" and your concept of "semantic" to figure out this new concept?

Yes. When someone is teaching you language as a baby you have eyes and ears and 100 million nerve endings and constant "training" to understand language. You cannot understand the word "semantics" as a human without this crucial "training" step. My god you people will pull out the most bs metaphors to justify being in awe(and debt) to a software program.
Yes, but are you claiming that LLMs perform more specific acts of cognition beyond organizing information?
I'm puzzled by this question.

Does the material universe perform any other acts than organizing information?

I feel like you're trying to make me argue a position I'm not defending here.

What does 'organizing information' exclude?
> There's no possible experience of the world there. No input other than a bunch of imperfect labels we created for stuff.

The brain too sits locked inside a bone box and only gets a bundle of unlabeled nerves connecting it to the outside. How can the brain could possibly experience anything, it only sees patters and patterns of patterns never the real thing?

> a bundle of unlabeled nerves connecting it to the outside

As a species, we do need to up our cable management skills. We're likely not getting augmented humans until we get there.

a bone box.. with eyes and 100 million nerve endings to experience the world...