Wow that is a great thread to reference, thanks!
I was shutting off the main tank valve when I tested the regulator so that makes sense. Obviously there could still be a leak in the regulator, but I'll have to try the test again with the valve open. The regulator is not super old, but it was...