The same people who determine what actions are “crime”, who gets to be “married”, what’s “pollution”, and so on. (See? The scare quotes apply to literally everything in society.)
In a typical democracy, those people are legislators, courts, and government agencies tasked with oversight.