Thanks for your replies.
I did not put rubber gaskets on both sides, only one, I will try putting a second one on.
I bought the bucket knowing it was a bottling bucket and not a fermenter, but hoped to use it for both purposes. If it leaks though does that mean that bacteria can enter the bucket?