It's not your money. It's partly mine and everyone else's in the country. Just like my money is partially yours. It's my business that you're paying your way in society in a correct manner so that I and others can benefit as part of a collective.
(Not that it's always fair but that's a different argument.)
Ah, so that's why the cops figure that having more than a few hundred in cash means it's partly theirs. Well, not partly, they generally seem to think is completely theirs.
(Not that it's always fair but that's a different argument.)