That's an interesting idea, but I'm not sure how it would work in practice. How much police abuse goes unpunished due to legal protections afforded to police, vs. police departments and prosecutors protecting each other?
I believe there should be a special prosecutor specifically for police. This would remove the conflict of interest between prosecutors and the officers they rely on to work with them to do their jobs.