Welcome to Knitting Help!
It sounds like it's stockinette and stockinette curls. It's the nature of the beast. The only way to tame it is to knit edges into it when you're doing it. Usually 4-5 rows of garter, seed stitch or some other non-curling stitch is what you need.
At this point I'm not sure you can correct it so you may just need to learn to love it curled. You could also try crocheting a couple rows along the edge, but that doesn't always work that well.
There is a sticky thread in the "How-to Forum" at the top of the page. It has ideas for this issue, too.