Most of us here started with Mr Beer. They have good kits, but they limit you when you want to move up to bigger batches. Although, if I hadn't melted mine, I would probably still be using it to brew small test batches.
I would research local homebrew supply stores in your area. Yes, you can get cheaper ingredients/kits online, but most LHBS stores are run by people who started out just like you are now, and are more than willing to help you get started (and make some money along the way). A lot of them host local brew clubs as well. If you ask, they will tell you when the next meeting is, and you can ask the members for help and information. You might even find someone willing to let you "ghost" their next brewday to really see if this is for you.
If you've read much on HBT, you will see that the vast majority of us are more than willing to help out our fellow brewers. That's the best thing about this hobby/obsession...it's not that competitive, and by helping out new brewers like you, we ensure continued interest in homebrewing.
Not to make this post too long, but you should also read How to Brew by Jon Palmer. There is an online version, or you can buy the latest edition at your local bookstore or Amazon.