[selcuka]

> I know there are other schemes where you only need M of N to turn the key

That's what OP suggests (Shamir's Secret Sharing).