That is a horribly wrong view point. Information required for business purposes, e.g. to write invoices or file taxes is considered user information you are fine to retain.
It's not about not having information, it's about having consent before acquiring it.
I think you are not understanding what the point of view is. These regulations inject a whole set of requirements on a hobbyiest, not for profit or tiny business to write code to track regulatory compliance and ensure that various processes exist the law requires. Those requirements are often more complex and costly than the core business.
It's not about not having information, it's about having consent before acquiring it.