[wmf]

Yes, LLM density has continuously improved. A recent 32B model beats older >100B models. It may level off at some point but no one knows when that will be.