As long as the closure seals, and there is no carbonation going on, use any container. I started bottling with 12 oz longnecks, moved on to champaign bottles, then to 2 liter plastic soda bottles. (2L bottles usually prompt an amazed look when the question is: Want a beer!) Someday I'll use the 5 gal soda kegs that I bought.
If you are unsure of the seal, try the cork, or 1 or 2 layers of plastic "saran" wrap under the screw cap.