|
|
|
|
|
|
by LoganDark
1153 days ago
|
|
|
The biggest thing I'm worried about is whether the unlimited context (via convolution) is anything like picking a random set of samples. If I give it a super long context and then tell it to recall something at the very beginning, will it be able to do it? Will it be able to parse the question if it's a very small percentage of the total context, even if the question is at the very end? Or is it just less computationally expensive to process the entire context with this method? |
|
|