If a news site wants customers to pay for the content, then they should put it behind a walled garden and not paywalls which only apply to certain used-agents and IPs.
And the 9th Circuit Court has determined that publicly accessible data does not require a license and the provider cannot dictate the means in which a user can access it. If a provider wants to do that, they need to place that content behind a walled garden.