I don't have a problem with either.
I like wool because it works to regulate temperature rather than just hold warmth and it's superior at wicking away moisture. Wet wool still insulates.
But wool is more expensive and harder to wash (assuming it's not a washable type which are even more expensive). Wool also tends to take on odors (sometimes even create its own odors).
I use acrylic because of price. If I could afford it I would use nothing but wool.
But I like to hunt so having the good insulating/wicking properties is important to me. I think for some it's nothing more than perception.
Petroleum based knitter, removing that nasty oil from the ground one skein at a time.