I've seen exactly this conversation countless times but instead of homebrewing it was about engineering, or computer science, or video gaming, or golf, or myriad other male-dominated communities.
It always amuses me when people can so vehemently argue that just because they haven't noticed a problem it doesn't exist.
NOTE: I'm not saying whether or not there is a problem with sexism on this site, I'm talking in general
Here's something that I find useful to refer to when this sort of subject comes up:
http://amptoons.com/blog/the-male-privilege-checklist/
Generally the last one is the most appropriate: "46. I have the privilege of being unaware of my male privilege"