I'd recomend cleaning them every time. I've occasionally just rinsed with water and reloaded, but you are risking it a little. Its takes a whole 5-10 minutes to do, and with the time you already have invested in making the beer, its a drop in the bucket.