That should be a pressure relief hole, as in when you turn down the pressure, the co2 in the line will be released through that hole to allow the pressure to equalize, otherwise you'd have to bleed the line yourself.
If it is always releasing, i'd go with the rebuild kit.