The "trick" to this pattern is that since it's an "illusion" you can see it better from an angle, AND after you've completely quite a few repeats.
I was having a similar problem in the beginning, in fact I almost gave up because it looked so WRONG to me.
I put it down for a few days and came back to it.
After it was done, I liked it so much, I made a second one.
Don't give up, if you're following the pattern/chart it should start looking like the pic soon.