Congress is one power structure. States and cities are others. 19 states have recall procedures. The fed is much less powerful domestically without state-level support. And pulling down even a couple state reps would send a chilling message to the fed.