A starter kit is a pretty good way to go. You'll outgrow it all eventually, but inception can be daunting without a guide. So, a kit and a good book is a great start. Try How to Brew or Joy of Homebrewing.
The one thing you need more than anything, though, is not included in any kit. It's this site. Keep reading.
Now there's some take delight in the carriages a rolling
and others take delight in the hurling and the bowling
but I take delight in the juice of the barley
and courting pretty fair maids in the morning bright and early