not in my experience. coming out of college, i worked for 3 years then took 18 months off. nobody i spoke to cared. if they asked about it, it was out of genuine interest for what i got into during that time.
Same for me. After my first job (3.5 years) I took a 1.5 year long sabbatical to travel around New Zealand. I even put that on my CV. I think it made me more interesting for the interviewer.