Certainly don't fall in with a crowd who you don't align with, but I find many church environments are happy to welcome anyone who's there for a visit. I have an elderly friend who globe trots on a budget and "just goes for the singing" I don't see anything wrong with that.