Hypnagogic hallucinations are common. They're most intense for me when I'm falling asleep in a very quiet room. You don't need a source of noise for this.
This put the fear of God in me when I was a child. Sleep paralysis, which often joins it, feels quite frightening to a kid who doesn't know what's going on.