Most sweaters that call for a smaller needle size for the ribbing...mean just that. Just for the ribbing
. If they didn't state 'change back to the gauge needle after the ribbing', they should have. Maybe an oversight on their part.
Change to the larger needle after the ribbing is complete!
Welcome to KnittingHelp!