If you own a farm in a city or area with high housing demand, yes, I think it would. (edit: and I'm not meaning this to be a sarcastic response -- there are urban farms).
What makes you think this is unfair specifically to an urban farm? What about an LVT treats this urban farm differently from a parking lot or totally undeveloped lot?
Oh my brain edited out the "unfair" part in the original question, I assumed it was just asking about higher value/tax. I think that an urban farm, baring some very extenuating circumstance, is an enormous waste of space. And I'm a part-time (non-urban) farmer.