[kant2002]

The finally behave slightly different in CIL. You have protected regions and finally/fault/catch/filters handlers attached. So in order to support continue inside finally you should introduce some state machine , which is complication and generally against Roslyn design limitation.

[MaxBarraclough]

ziml77's point is about the behaviour of the C# language. You seem to be talking about implementation concerns. They're not relevant.