The regression will 'set the value of the parameters'. OPs point is that when you want to change the regression your main 'hyper-parameter' (i.e. one that you get to choose rather than one that the system determines for you) is the number of parameters.
Most Neural networks have other hyper-paramters, but the ones in SR are probably quite interpretable and intuitive.
Most Neural networks have other hyper-paramters, but the ones in SR are probably quite interpretable and intuitive.