I started with a 3 gal kit, beginners extract ingredients, and a buddy. We sanitized the heck out of everything and made a nice first batch. The first step is wanting to do it and not giving up! I've been brewing for about 1 year and learned a ton with 8 batches under my belt. There's a lot you can do, not just beer. I've been getting into fruit mead (melomel) lately because I don't have to boil. They're quick, easy, taste awesome and all my friends love them (see avatar pic). They make great gifts too.
Also home brewing has got me into gardening, a lot. I'm growing cascade hops, chamomile, horehound, hyssop, and other herbs for brewing. I like trying new things and learning from my mistakes.
My experience, homebrewing is not a frugal hobby. I've spent ~$700 on everything but it's something that's becoming a skill and an outlet for my science mind.
I asked a friend if he wanted to get into homebrewing with me. What he said totally steered me toward where I am today. He said "I don't think you could brew beer better than what you can buy." I wasn't sold on his logic, so I started making me own, and enjoy it more than just buying some beer at the grocery store.
Who knows, maybe someday you'll brew the next best thing. Home brewing is amazing!