With non paper labels, vinyl or foil, I found that very hot tap water will soften the glue, letting me peel the label off. A razor scraper (carefully) will remove almost any label. A soak in hot oxyclean removes most glues.
If you keep collecting bottles, you can discard the stubborn ones.