If you left it in the primary fermenter for 3 weeks sitting on the yeast cake, that can contribute to off flavors.
Once the keg is cold, I don't move it back out again until it's gone. It should age ok in the keg and I the fridge. Make sure your temps aren't Arctic too, as too cold and it...