+1 for craigslist.
I found my corny kegs and c02 bottle on there. You can also find good deals on chest freezers. The only stuff I bought new was taps, lines, and fittings, and stuff to build the thermostat. Much cheaper than buying a pre-built one.
Also, I started off with a buying a...