Everyone here has great ideas, but I think the most important aspect that some of you have touched on, but probably not enough for someone wanting to homebrew as a hobby, is the aspect of TIME.
The most important thing you will need in order to be successful and last in the hobby is TIME. Without being able to commit time, you can make beer, but if you want to make good beer, you need time.
You will find yourself devoting time to the following things:
Learning the basics
Researching what you need to brew
Researching what you want to brew
Researching how you are going to brew it
Researching how to improve your brew
Researching how to fix your errors
Researching how to implement new techniques
Researching what ingredients you want to use, etc etc,
(Researching is what I spend 95% of my homebrewing time doing.)
Brewing Day: figure an entire evening, regardless of the method you use to brew it.
Shopping and DIY: I spent a ton of time figuring out what I wanted to spend money on, how much money to spend on it, and how to cut costs by making items myself, buying in bulk, and harvesting yeast.
I'm sure I've missed a lot with regards to what will use up your time, but if you are willing to devote a ton of time, and are willing to truly learn and listen to a million different opinions to form your own, then you will be successful and this will be a lifetime hobby.
I know a lot of people who don't want to devote the time, and don't care to improve their knowledge. Yes, they brew, but they don't brew as well. The person who got me hooked on brewing fell in this bucket, and after 6 months I knew 10x about brewing than they did.
I started by reading this forum for a while, doing research, reading through How to Brew, and then buying a basic starter kit and kettle. That is enough to get started successfully. After that, you need time and commitment to learn.