Fermentation temps that you describe should not be that troublesome. The problem is simpler.
The tastes you are describing can be from chlorinated water. Don't use tap water, either buy a filter or use bottled water.
Don't put ice cubes in the bucket to chill the wort. If you are doing a...