For the first time, hot water and maybe a little soap. Rinse it off really well.
When I run water through the chiller, I collect the water in the bucket I use for fermentation temperature control (a big one from Walmart). When I'm done chilling, I stick the IC and anything else I need to clean into that tub of hot water and use a washcloth. Works pretty good.