I was thinking the same thing as Sarah, the size of the garment wouldn't be affected but the drape and look of it might be.
You can do it but you might want to swatch first and see how you like the results.
I'm Zkimom on Ravelry
Check out my photoblog: Photobella
Well, I've wrestled with reality for 35 years, Doctor, and I'm happy to state I finally won out over it.
--Elwood P. Dodd