Sounds more like your regulators are not all that consistent, since the problem persists when you are trying to adjust one of them. Regulators are very simple mechanical devices. You should make all adjustments with the valves open and give them a couple hours to stabilize.
There is also the possibility that your check valves leak enough that you are seeing keg pressure after a bit, regardless of how you have the regulator set.
Remember one unassailable statistic, as explained by the late, great George Carlin: "Just think of how stupid the average person is, and then realize half of them are even stupider!"
"I would like to die on Mars, just not on impact." Elon Musk