if you're really worried about it you can get replacement swing tops for about a buck a piece:
http://www.austinhomebrew.com/product_info.php?cPath=178_356_63&products_id=1020 2&osCsid=493082960266689775b212d4c35c5211
or you can buy a case of 1/2 liter swing tops for like $30, which works out to $2.50/bottle. no labels to remove, no markings on the bottle to worry about, and they're amber so you don't have to worry about light exposure.