Yes. That's how you do it; you freeze it and take out the ice, haha.
I've had good results setting outside overnight in a plastic bucket. In the AM, I scrape off whatever ice has formed. It'll be clear ice and usually sheets of it on the top & sides. Super easy.