Not necessarily, the seal between your regulator and your valve is suspect. I like the little fiber seals that go between the connection. They smash in there real nice. I coat them with keg lube or food grade petroleum jelly and tighten them down snug and have no problems.
If you can see a crack on the seal face (brass) of either your regulator or shut off valve, that is another story. Try a new seal first.