Hacker News new | ask | show | jobs
by embedding-shape 18 days ago
> How do LLMs do it? They don't learn by writing a lot they learn by reading a lot.

Literally they learn by both, training process is filled with "exercises" for the weights to be shaped by, not just "seeing" tokens :) At least the typical LLM that outputs tokens have to actually "practice" doing so.

1 comments

True. Just saying we learn not only by lots of trial and error, but also by trying to imitate others.