Being bad at extrapolation is a consequence of assuming all training data can describe your phenomena distribution and being wrong.