It doesn't really though. The prediction algorithm already existed before training, it just is a particular collection of parameters that the training produces. You wouldn't say changing the interest rate changes the algorithm for calculating interest payments. The weights can be viewed another input to the algorithm. You aren't going to outlaw linear regression, but a particular set of coefficients.