I think fact that you get fired if you bring up biology at your company's brown bag on diversity (a la Damore), means, just maybe, that you can't actually say some of those things.
Freedom of speech is not freedom from consequences. Damore made some factual statements (this is OK), but then attempted to draw some non-factual conclusions from those statements that made his continued employment impossible (what if he was part of a promotion or hiring committee for a female employee? his prior statements would be pretty damning)
Read Damore's treatise and replace every mention of gender with one of race, and see how it reads.
Read Damore's treatise and replace every mention of gender with one of race, and see how it reads.