Your swatch should actually be bigger than 4x4...you just measure a 4x4 area in the middle of it. If you have too many stitches per inch, move up a needle size; if you have too few, move down a size.
Here's a great article about gauge swatches:
http://www.knitty.com/ISSUEspring03/FEATswatchout.html
:D