|
|
|
|
|
|
by throwawayForMe2
1150 days ago
|
|
|
>> The next major leap in LLMs (in the next year) is probably going to be the prompt context size. Right now we have 2k, 4k, 8k ... but OpenAI also has a 32k model that they're not really giving access to unfortunately. Saw this article today about a different approach that opens up orders of magnitude larger contexts https://hazyresearch.stanford.edu/blog/2023-03-07-hyena |
|
|