If there's a LHBS in your neck of the swamp, go there and see what they have on hand for equipment, kits and ingredients. Make sure that the person behind the counter actually brews as well. If not, find another shop.
I got my start with kits (hardware and recipe) from Strange Brew here in MA. I started with the two bucket kit, auto siphon, etc (pulled the bottle capper out of the kit, since I'm using Grolsch style bottles)... Even though I've started getting my grains, and hops, from another store (ordering online) due to much better pricing, I still go to the LHBS to get some items that are either priced the same, or a little cheaper. Plus, I can bring samples of batches to them for second opinions. It's good to have people, that have been brewing for years, taste what you're making too.
I would second the info about not needing to rack a brew to another fermenter after X days. Let it ride on the yeast for 3-4 weeks (longer for bigger brews) and you'll get even better beers out of it.
I would also say that you should get a large pot... Get something that's a 32 quart (or larger) for when you go all grain. Or that you can use for full boil 5 gallon batches. You can use aluminum or stainless steel (there's a sticky about using aluminum, just condition it and you'll be fine)...
Also remember, quality in, quality out... Better ingredients will get you a better brew.
Personally, I've liked using carboy's to ferment in much more than buckets. That being said, I'm working out the logistics of switching to using corny kegs for primaries... I'm hoping that I'll be set to do that within a month (or so)... So probably in about two batches, I'll be using corny kegs to ferment in.
One advantage (for me at least) of carboy's over buckets, is you can see (without opening) when you're post-lag phase in the process (after pitching the yeast in). You can also see if things are getting very active, and you need to install a blow-off tube (be ready for that ahead of time). I've had that happen even in 6 gallon carboy (blowing foam through the airlock)...