I use an ordinary glue stick - the labels wash right off in warm water.
Of course, if you drop the bottles in a cooler and they get wet, the labels tend to come off prematurely - so I always put a little round sticky label on the cap so nothing ends up unidentifiable.
Both the glue stick and the 3/4" round labels are available at any office supply.