I see most of these suggestions are for reference books. Add this site to the top! Easy to use, plenty of support and the price is unbelievable!!
As for magazines, Creative Knitting is okay and I really like Knit n Style.
Well for me, I loved the book Itty Bitty Hats by Susan Anderson. I had only been knitting a few days when I got that book, and it was really great for a beginner. Lots of cute projects and very insightful!!