I agree with Brenda and Jan. Time and practice WILL speed you up. After knitting a lot within the past few months, I am really speedy with knitting.
I'm just trying to figure out more things every day. Just set out some time for knitting either everyday, or at LEAST once or twice a week. Practicing will get you going faster.