Super yarn and pattern! Wow!
I liked oatmeal best but also got pulled toward "flannel". I know it's not as "neutral" as the oatmeal in the strictest sense of the word but it's gorgeous and might visually read as a neutral.
Either way you'll have an awesome sweater!
Keep us in the loop (so to speak!)