You guys are funny...which is one thing we love about you!
I don't think it's an issue for anyone...more of a curiosity. I know the historical aspect of men knitting, but we rarely see them like we see women. We had guys show up from time to time at our knitting group in the yarn store, but it was rare. You're like that rare bird or animal that everyone talks about..they know they are around, but they are seldom heard from or seen. When there is a sighting everyone goes nuts, but then if they stay around they just become part of the group.
My DH does the cooking, too. He is artsy..does ceramics, paints, woodworking... but while he loves what I do and offers many thoughts he's not interested to try knitting.