Yup Mason, I think it's the cotton factor--especially if it's not mercerized or whatever that process is called that makes the "nice" cotton yarns smooth and shiny.
I have a stash of Peaches'n'Cream/Sugar'n'Cream...every once in awhile I take it out to make a dishcloth and having a knock-down, drag-out friggin fight knitting with it. It has no give or elasticity, and my stitches usually look lumpy and uneven. Then I get angry and slam the cotton back into my stash--remembering why it was there in the first place.
It usually takes me about 3 months to forget how much I hate it and try again