I looked at your photo again and I think you picked up the stitches at the p2 of your ribbing. I think that's what makes it look odd. Maybe next time change the placement of your turns so that they're all picked up on the k2 of the ribbing, or you might do a row of plain stockinette before you start the short rows.
You can't knit the left sock first. Ever.