Where to join new colour when striping in the round

[catownedanna]

I'm about to knit a striped raglan sweater and I'm just wondering if you guys can help me figure out the best place to change colours. I'm going to do the jogless join-thing to try and even out the differences in rows, but still I'm not convinced on where to do this.

I think the obvious would be to change colours on one of the sides but this design has me making pattern stitches at the "side seams" (that aren't there), along the raglan edges and under the sleeves. The pattern is simply to purl four stitches on every other row at the side seams.

Joining a new colour here wouldn't make the "seam" look good and if I join next to one of the "seams" I'm worried it'll look strange when I reach the raglan part.

So, I'm thinking I should chance colur at the center back. What do you think?