Hacker News new | ask | show | jobs
by apwell23 889 days ago
> Current LLMs can not summarize books even if they are in their training set

Why is this? due to legal reasons?

2 comments

The context windows aren’t large enough, as I understand it. It might be possible via a chain-of-summarization, though.
Most importantly due to the context length not being long enough. If the context length was long enough, it is possible that they could do it with clever training. I only trained much smaller language models though.