It's very true. Having been a heavy user for 4 years in my late teens, I do notice that my memory isn't what it used to be. I'm having to write things down all the time, including people's names and stats.
Well, you know one thing was true and another is also true, but the same thing happened to me long before I started doing much with weed. In my late teens I had a few subjects absolutely locked into memory, and then in my early to mid twenties I struggled to remember names until I'd met them 3 times.