[te0006]

This seems to be the Feynman episode in question: https://thinkingwiththings.wordpress.com/2012/03/16/richard-...

If you are a fan, be prepared for quite some unpleasantness. Turns out, the story isn't even about topology. No, Feynman was, in his own words, "flabbergasted" that women were able to grasp and explain to each other rather basic matters of analytical geometry.

[swaginator]

That's a similar but different anecdote. The one I am thinking of he specifically is talking to someone's wife while she is crocheting. It may not have been Feynman though, I CTRL+F'ed "Surely You're Joking" and wasn't able to find it or I would have cited my sources in the parent comment.