From what I have seen of history, the most intelligent people (from what we have been able to tell) are never a regular part of the mainstream. They only dabble occasionally.
Are you saying Jefferson and Einstein are mainstream? That is clearly not the case. Their popularity is, but their actions were from from it. Hell, just LOOK at Einstein!