The .edu blog comment spamming isn't going to help. I just did a quick look on Open Site Explorer, and your link profile looks super shady. You're setting yourself up to get Penguined if you aren't already.
Thank you for pointing this out. Maybe this is what's hurting my site. I'll use the link disavow tool and see if that helps. Thanks again for your input.
Don't forget to do a reconsideration request after you use the disavow tool. You'd be better off getting rid of the links, but that might be difficult.