You can line a hat quite nicely with fleece material. It doesn't fray and is very stretchy. It is also very warm so might not be good if you don't live in a cold climate. It will make the hat a bit smaller but I've not had a problem using it. TechKnitter has a tutorial about lining hats.