Sounds like you didn't give the yeast enough nutrients and/or premature kegging. Copper sulfate will reduce it, but you need to read up on proper dosage, etc. so that you don't end up with excessive copper in the final product.
The Fiesty(sic) Goat Brewery est. 2007 & Clusterfuggle Experimental Ales est. 2009
Primary: Saison, Berliner Weisse, sLambic I, sLambic II, IPA, 70/-
Secondary: Orange Blossom Mead, Flanders Red I
Kegged: Fat Man Porter w/ 1469, Fat Man Porter w/ 005, Centennial Falcon w/ Conan, Centennial Falcon w/ Denny's, Barrel-aged Fat Man Porter, Belgian Dark Strong, Dark Mild