I was scared of turning the subscription off, but no, it's fine. My own library is still there. They used to have a terrible matching algorithm for Apple Music, different to iTunes Match, but switched it pretty early on. I've had no issues for a number of years now.