Here's a good inexpensive place to start. I've seen her starter kits recommended in other spinning forums. I personally own her book Productive Spindling.
http://www.thebellwether.biz/index.p...dex&cPath=2_23
The Schacht Hi-Lo spindle is what I started with, it can be used as a top whorl or bottom whorl so you can try either way and see what works best for you.
http://www.paradisefibers.net/Schach...dle-p/4006.htm
A really good dvd to get you started is Respect the Spindle by Abby Franquemont. I just got my copy and there is a ton of info in there on how to spin on a spindle.
I've seen people say they've started on any variety of fibers, but what's most commonly recommended is something like Corriedale or BFL. They are readily available and fairly inexpensive.
Happy Spinning!