There was a good thread about the warmest possible hat on Ravelry recently with some good ideas.
Dot's idea of nylon was one, fleece linings were another, and both of those being the warmest. TechKnitter has information about lining hats with fleece on her blog. Here is a LINK
. She also has info about just lining a headband into the hat, of fleece.