Ahh, I would have to dive into the details again to get the exact answer...
But from what I can recall is for reverse DNS I need a PTR record also, and for a PTR record I need to know my IP's reverse zone (or setup one?), and that's where my ISP came into picture as the owner of the IP block, as they are the only ones who can do that.