You should probably cast on more than just 21 stitches to measure. The edge sts tend not to be the same size as in the middle and curl under. So try about 30 sts and knit about 3", then wash it like you will the sweater when you're done. Then see what happens.
sue- knitting heretic