Are you saying that your beer lines are running from your keg, to the outside of your fridge, and then back in, up to your tower? If so, that could cause the problems you're speaking of, but I'm not sure that's what you're saying.
If your lines are contained entirely within the fridge, then...