If it's in a large flat area like the back or in stockinette I would probably frog it. Mistakes don't show in some patterns too easily, but they scream out in stockinette usually.
I also agree that if it's going to bother you at all and you keep going back to it, just frog it and consider it lesson learned. BTW..if you had frogged before you may have picked up the stitches wrong and that might be why they are twisted. If you encounter a twisted one you can knit into the back of it to fix it. Amy has a video.