|
|
|
|
|
|
by antonvs
2 days ago
|
|
|
> how much is just pattern matching and borrowing a solution from memory. It's easy to show that this is not the case. This is a well-known phenomenon in ML, known as generalization - specifically, compositional generalization. See e.g. https://research.google/blog/measuring-compositional-general... for a description - although note that that post is from 2020, and models have become much better at this since then. People can "believe" what they want, but there's plenty of work that definitively falsifies beliefs about "borrowing a solution from memory". |
|
|