nail polish remover, the ester ethyl acetate if that's where you want to start your research. Coincidentally because....its actually in nail polish remover.
If you are sure the taste wasn't there before, i would let the bottles ride at room temp for another week or two, and test one again. If...