That setup won't get you all the way...
I'm not sure what you mean by "not a lot of cash" but you've got a couple options.
Check local welding shops - sometimes they can lease you a tank (kinda like propane tanks, when its empty you can exchange them) - that way you on't have to buy one immediately. This way you can start w/a 5 lb tank and move up to 10lb on a whim - if you need it. If you want to purchase a tank - look for used tanks - new CO2 tanks can be way overpriced - I guess if you want it really shiny go for it, but all the thing needs to do it hold pressure (make sure it is currently certified).
You don't need a dual-guage regulator - the pressure in the tank is really unnecessary - I've never used mine. (You can tell how much more CO2 is left more accurately by weighing the tank anyway.) This can save you some bread.
Check for used kegs on craigslist or on ebay - I picked up 5 on ebay for $75 shipped. (You still need to replace all the o-rings - but this is cheap & easy)
Don't forget quick disconnects & tubing & hose clamps - this stuff is pretty cheap. (Line is about $.5/ft - you should have three feet for beer & three feet for gas)
(disconnects are about $5-6 each - you'll need one for gas & one for beer)
http://www.northernbrewer.com/kegs-disconnects.html
hose clamps to connect line to disconnects ~$.75 each (any hardware store)
Total:
Keg (get a used one) = $20
O-Rings = $5
Tank (used) = $40
Regulator = $40
Disconneccts & Line $ tap = $20
Clamps = $3
Total = ~$128
I know you probably want to keg your next batch - but you'll pay a lot more if you don't make some phone calls around to brew shops & welding shops to see what your options are. Don't be afraid to pickup parts here and there until you've got it all.
http://www.northernbrewer.com/draftbeer.html (some decently priced fittings, cheap regulator, etc.)