I think glue would leave a stiff spot and may not be washable.
How about snap tape?
Or you could sew grosgrain ribbon on the back of the garment at the fronts and then sew the snaps on?
Here's some magnetic ones.
Just google snap tape or magnetic snaps and you'll get lots of hits, too.