Audiophile to me is not a bad word, and I use it frequently.
From Websters, "A person who is especially interested in high-fidelity sound reproduction."
Nothing elitist or politically incorrect in that.
I went to School at a very large University. My undergrad years were 1977 to 1981, right in the HEART of the late 70's HiFi solid state boom. I dated my behind off, and had parties in my apartment (I lived off campus in my Junior and Senior years) every weekend. I probably knew a thousand girls and tried to date every one of them, without success of course.
NONE of these women were into high end gear at the time. LOTS of guys were. Me and 90 percent of my friends, many of whom were taking Electrical Engineering, would debate audio to the 3rd Degree nightly while listening to Rock and Jazz. The girls would comment on how good the systems sounded, but most of them had Soundesign or similar stuff. A few had some decent Pioneer rigs, but not very many.
I think it's possible that Women can be Audiophiles, but the ladies I know today are more into hooking up their iPHones to a Bose Wave Radio than pursuing true high fidelity systems.
Like someone mentioned earlier, sure, it's possible. But just like shopping for shoes, most guys pass. Yet some like it, although it's a rarity.
Same with Amateur Radio. Sure, I've seen Female Ops, but they are not common. The bulk of it is "Guys".