This part of the pattern (6 stitches only) should get taller to give you a nice opening at the neck. Is the hole at the decreases for the neck edge? If so you can decrease one stitch in from the edge. That will give you a nice line along the neck edge.
Pattern one row shouldn't be any more difficult to work than the previous rows. There will be an opening at the center but that's part of the pattern. If it makes it easier, you can slip the unworked sts to a holder while you work with the 6 stitches for the shoulder then go back to the held sts for the center and the second shoulder.