Managing my water profile (start with DI water and build up) is perhaps the one single change I've made that had the biggest impact in the taste of my beer. If you are using tap water you must dechlorinate or youll get a subtle or maybe not so subtle "bandaid" taste.
As far as sanitation...