|
|
|
|
|
|
by bt1a
1015 days ago
|
|
|
That's a great way of looking at it. Comparing model weights to our brains and how we process input, you could imagine model weights as a brain frozen at time t=0. The prompt tokens are the sensory input, and the generation parameters are like twists to how the neurons pass information to each other. The token context window is like the capacity of one's working memory. At the conclusion of the last layer of processing, the output tokens are like one's subjective experience. At the least it's made me think for a moment about `stateless` and its meaning |
|
|