Hacker News new | ask | show | jobs
by metalwhale 871 days ago
Thank you. Can I ask a question?

Does this mean LLMs can generate text with empty context? How can LLMs choose the first token without any previous tokens? My understanding is that to compute logits for the next token, LLMs require input from all previous tokens. Am I correct?