I ended taping it down with some electrical tape. Not the most elegant solution but it stayed in place. Williams Brewing is sending me a replacement. They said it's possible I got the wrong size.
Revvy, I do not have this issue with my regular rubber stopper, even when wet. Always stays in...