[kieckerjan]

Off topic, but the article mentions "deep learning at scale" which triggered me. Is this use of the term "at scale" something new(ish)? As far as I know "at scale" means something like "in the appropriate amount". Here it seems to be shorthand for "implemented in a scalable manner". This use seems all over the place now. Is there a native English speaker who can comment on that?

[xtacy]

I am not a native English speaker, but quite familiar with the use of "at (large) scale" in similar context.

It means that one has deployed it/is using the tool with a non-trivial (could be anywhere from few 100s to few 1000s of machines) amount of CPU and/or data. In the context of serving, "large scale" could also mean the number of queries/second hitting the serving layer.