I find both "men's fiction" and "women's fiction" equally dismissive because it makes a silly blanket assumption implying it isn't for one gender or the other. That annoys the hell out of me, not because I don't like the idea that women or men would like to read my books (I would welcome it) but because I can't abide the notion of implied prohibitive exclusivity.

I just don't like labels that implying a restriction on gender. Obviously people can read what they like, but I wouldn't want men or women put off reading my work due to such a label, because my work is for everyone. Such a label wouldn’t deter me, as I’d just roll my eyes and read regardless, but I know it puts off some men and women, if confronted by such a label. Why put up unnecessary barriers encouraging people with prejudiced minds to rush to judgement on a story they might enjoy?

I hope that answers your question. :)