Yes, patterns will call for different sizes just as they call for different size straight or circular needles. The different sizes are used to adjust the gauge (stitches/inch) so that you can knit to a given size.
You can buy each size as you need it. You don't have to invest in a whole set at once. You may even like to play around with different composition needles: plastic, bamboo, metal.