[antipaul]

Totally. Often, I see a copy paste of that canonical regularization figure in TL,DR 1. which I’ve never seen adequately explained.

Until this post.

Edit: Ok and now I see what you did there ;)

[parrt]

haha. :) Yeah, I got stuck for SOOooo long trying to reconcile the standard picture from ESL book with the math. Turns out they don't match! The picture is for a hard constraint whereas the math penalty term just makes bigger coefficients more expensive. Man, that really threw me.