just how much chlorine are we talking about? and is it really chlorine? or is it chloramine?
chlorine will evaporate during the boil...but chloramine will not.
my water contains some chloramine, and I've never treated it. my beer tastes great.
if it doesn't smell like pool water, I'm not sure I'd worry about it, unless your previous beers did taste bad/medicinal/plasticy/band-aid like.