Hacker News new | ask | show | jobs
by iraqmtpizza 785 days ago
LLMs don't have neurons. That's just marketing lol.

"A neuron in a neural network typically evaluates a sequence of tokens in one go, considering them as a whole input." -- ChatGPT

You could consider an RTX 4090 to be one neuron too.

1 comments

It’s almost as if ‘neuron’ has a different meaning in computer science than biology.
LOL you just owned the guy who said "LLMs with a much smaller number of neurons than the brain are in many cases producing human-level output"