Cooking oil dissolves most glues I encounter that soapy water won't. Rub some oil on with your hands then clean the oil off with soapy water. It's better than putting harsh chemical solvents (e.g. gasoline) on bottles you're going to drink from!
Rouge Porter labels used to drive me crazy...