As long as you only keep it on the low pressure secondary side after the regulator and between your stone it will be no problem. You will shut off the primary side valve at the bottle before the regulator when your done adding oxygen to your wort in the fermentor? It's not good to leave the regulaltor handle screwed down on the diaphragm while in storage, this a strange practice while your Co2 regulators are set full time. I'm going by good welding practice on this one as safety with the bottles valve also shut plus preventing your bottle or tank from becoming empty weeks later if the regulator leaks or keeps creeping up in pressure way above your set secondary pressure.
