Take a look at the video from the Glossary tab for k2tog
just in case you're doing it differently. Usually the k2tog leans to the right and I'm not sure I see that in you photo. The decrease shouldn't leave a ladder, in either case. There's also a video for p2tog in case you want to look at that too. This is a link to a picture of the hat.