I use Oxyclean on anything that isn't metal. If it leaves behind residue, vinegar will clean it up, and warm water will wash away the vinegar. Use sanitizer the next time you brew. Basically your goal is to effectively clean everything with a solution that won't leave smells or residue behind, then sanitize before reusing.