I had mine removed when I was 32. After going around and around for about 3 years being sick on and off anti-biotics. Which is not fun or good for the body. Mine got so bad that one actually perforated.
Being a redhead my doctor told me to take two weeks off. I can honestly say that in the previous 3 years before I had mine out, I had worse sore throats than the recovery one.
Don't let anyone scare you. It seems from what you are saying that it's time for them to go. It's surprising how run down you can get from something most peoole got rid of when they were kids.
Work the system and eat oll the ice cream you can handle....