In Z mod 5 using your notation, you have that 3 = -2. It doesn't make sense to distinguish two classes of "negative" and "positive" numbers in that case, but it still makes sense to talk about -2.
That was precisely the original point - the distinction only makes sense in an ordered set; otherwise, calling -2 "negative" may be devoid of any meaning (e.g. when -2 = 3).