[CuriouslyC]

Parameters don't have diminishing returns so much as we don't have enough (distinct) data to train models to use that many parameters efficiently.