The question is not "which pattern book" but "which knitting book."
Before anything else, you need a good technique book that contains answers to the questions that inevitably arise when you are learning to knit (and there's no end to learning about knitting). The books you mention are okay for learning beginner techniques but you'll quickly outgrow them.
The three best choices, in my opinion, are:
- Vogue Knitting: the Ultimate Knitting Book
- Knitter's Handbook by Montse Stanley
- Knitting in Plain English by Maggie Righetti
The first is authoritative and easy to use. Not cheap, but consider it a lifetime investment. Great illustrations.
The second is quirkier but so packed with information that I can't live without it.
The third is like having a good teacher at your side.
The videos on this site are also very good for learning individual techniques.
When you've got your technique book, consider "The Knitter's Handy Book of Patterns" by Ann Budd, which you mention. It'll help you make anything you want, in any size, and in any yarn. Indispensible.
THEN you can start thinking about pattern books. You'll find that they can be an expensive habit: a $25 book may contain only one or two patterns you are really interested in making. You may be better off buying individual patterns online from designers whose work you like. This site is one example, but there are hundreds: highcountryknitwear.com
Depending on your interests, you might also want a sock book, a scarf book, a mitten book. The descriptions on Amazon are not bad but the comments from readers are very useful in helping you decide whether a book is for you or not. Or ask about specific books on this forum. (Several other knitting forums have ongoing book threads.)