(((HUGS))) hon. I know how you feel... just take a look at my siggy! LOL! I remember feeling so horrible when she ripped it off her little body and refused to put it on! When she saw me coming again with it, she would run!
It took me a little while to get over it but I feel better when she comes around and tells me she wants to knit and tries to take my knitting away to try (she's 2). I'm sure he'll appreciate your knitted items more as he gets older.