I used to have that problem (and it's a problem I'm working toward having again), and since I don't trust myself to adjust the patterns, I just kept looking for XS sizes. They are out there, but they are hard to find. The good part of it is that this kept me from buying all these patterns that I could never find time to knit.
Some good places to look: Patons generally has XS sizes (and 4XL, too); sometimes Tahki or Filatura patterns have XS sizes. The disappointing thing is that most websites aren't set up to search by size for knitting patterns.