I would doubt that water or hard water would cause a 'harshness' in the back of your throat, likely something else. If it was so clean that you tasted the water, I doubt that you would have beer. Are we talking about mineral/metallic flavors? If so, it could indeed be water, old hops, equipment/process. Tannins from too much sparging could also cause a harsh taste, I suppose.