It looks good, but you may want to watch the waist shaping. men are generally straight through the torso, whereas women need shaping for the waist. Take a look at this unisex pattern from knitpicks.
http://knitpicks.com/Plain+Vanilla+P...D50559220.html
Hope this helps you out.