I have often wondered whether not
binding off any of the pieces would work -- rather, keep the remaining stitches of each piece on hold. Seam the pieces together then put everything back on one circular needle and either do some kind of neck finishing (collar, roll neck, mock turtleneck, whatever) or simply bind off all the stitches at once?
I dunno, just a thought. It's something I've yet to try out myself!