That was true in a significant number of preference pages in the old Settings.app as well. It's probably the same code paths under the hood of the new UI.
I don't doubt your experience but that doesn't match mine. Third-party preference panes were slow for me in the old app, but I never noticed any lag with the standard ones.