I can't say exactly why it is, but I bet no one would have felt off-put if you had offered gift cards instead of cash. People in general will be much more comfortable taking a gift card than cash.
The person probably thinks "I can afford a cup of coffee so I don't need your money". A gift on the other hand is meant to be given away so seems alright.