Probably not, as long as you sanitized it. I accidentally pushed a silicone bung into a carboy full of wine and it was OK. Granted, I racked it only a couple of weeks later once the lysozyme I had added settled to the bottom. I can't speak for rubber bungs, though. I always smell that rubber...