Yeah, you should check your system before leaving the tank on, but in order to force carb your beer you need to leave it on. I guess it would be slightly safer to turn the gas on and off every time you use your kegerator, but as long as you check for leaks beforehand, you'll receive no benefit for that inconvenience.