[OafTobark]

There are companies that already do this and remove "managers" altogether.

Example: http://vimeo.com/43676958 (Github)

There are many others. It all depends on the type of company and culture. The exact things that work for Github may not work for other companies in that exact form but there are obviously ways to do so in different fields, etc...