I love this idea and agree you need a form of curation. Is there a mechanism for "ranking" links? Or reporting? I think a simple UI that lets you up or downvote (after clicking) could be pretty effective at reducing spam.
totally, this is a feature I am working on. might even just do a report feature and remove anything that has been reported too many times by different people before doing true ranking.