Through research and comparison of prices of items included, and comparing shipping prices, I found that
Quality Wine and Ale Supply was the best deal for me for getting a complete wine setup, including a kit. I wouldn't recommend them for follow-up individual items like chemicals or single pieces of equipment, though. If you can find a home brew shop nearby (called an LHBS, or Local Home Brew Shop), I would copy the list of items at Quality's website, and try to find them all at your LHBS, as it would be undoubtedly cheaper. I haven't any LHBS shops within 90 miles, so I have to get all my stuff online. It's expensive to pay five bucks shipping for a two dollar airlock.
I think Jack Keller said that one should learn to make wine from scratch first, and then try a kit wine, but that's hard to tell anyone who hasn't a little experience. I know I would never have gotten into wines and meads without doing the kit first, as it seemed a daunting task to learn how to make wine from scratch. The kit seems easier, and it is, but in my own personal experience, I have found that I like what I make from scratch way more than I have made from a kit.
I encourage you to try to make mead, as it is easier to do, again, in my personal experience, but it takes a LOT longer to allow the product to age before even beginning to assume its full potential. I have found, quite simply, that mead is far more versatile, complex, and just downright tastier, than mere fruit wine.
The cheapest ingredient in home winemaking recipes is also the most important: patience. It is also the hardest one to add in the correct quantities.
My experiences only, and I am far from a master vintner. Good luck; this is a great hobby.