[anon373839]

Could they even afford 4B dense parameters touching every token? That seems like a LOT of compute compared to generating the classic Google SERP.