I just bought some Tatamy Tweed for a sweater in the oatmeal color.

That's a beautiful sweater and mitts!
How far did you decrease down to? If you stop one decrease row sooner and then finish it will probably help. I put the yarn down through the center and weave it in inside that also seems to help on hats as well.