|
|
|
|
|
|
by marshmallowmad
1164 days ago
|
|
|
I don’t quite understand why context length needs to keep growing. It seems to me like many tasks (e.g. customizing your LLM on your own data) would benefit from the model doing some sort of sped up fine-tuning on any prompt that gets added. That way we don’t have to find all these hacks to find the most relevant context and repeat the same info in prompts. Curious if anyone has insight here as this has caused me some confusion lately! |
|
|