People doing all the work of dependency fetches, code builds, and test execution inside ephemeral environments never designed for building software within.
Fetching packages isn't the problem. The problem is the lack of "out of the box" caching pf the downloaded packages. You'll have to do that yourself with artifactory and Docker does not nudge you towards doing that, at all.