Not really- but you can, to keep the cork moist. My reading leads me to believe that even upright the corks are moist enough, due to bottle being sealed. I suggest leaving them upright for at least 3 days or so, for the cork to uncompress (is that a word?) and make sure the bottle is sealed. Then it can be laid on its side if you want.