I assume by "bubbler" you mean an airlock, correct? Are you using a plastic bucket or carboy as your fermenter? If Carboy you should get a tighter fitting bung (they do come in different sizes). If bucket, you will either need to shove the airlock down further and/or make sure the black o-ring is in the hole. This creates a seal and prevents the airlock from coming out.
Another thing you can do is run a blowoff tube to a container of sanitized water. To see how to do this, just search for creating a blowoff tube for home brewing.
Good luck and cheers!