I soak mine in a cooler full of very warm water and an oxidizer like Easy Clean. After a few hours of sitting in there, the labels start to float to the top. I then remove all the labels, briefly scour the outsides of the bottles in the water to remove excess glue, and afterwards rinse.