Oh, yes, aging will definitely mellow the tannins and smooth it out nicely. Depending on how much you overdid, it might take 6 months to several years, though! Normally, about 6-12 months is plenty for a moderate amount of overoaking.
__________________ Broken Leg Brewery
Giving beer a leg to stand on since 2006