When you go back and forth, make sure to knit the knits and purl the purls. If it looks like a knit, knit it; if it looks like a purl, purl it. My guess is that you're trying to do it the same as in the round and that won't work.
You're not crazy, you're a knitter.
There's a cure for crazy.