You'll need a refrigerator of some kind, large enough to not only cool it but get CO2 and hook up some kind of dispenser. A picnic tap will work but not optimal.
Going kegging doesn't have to be expensive but you'll have to already have a refrig or keep an eye out for a deal on a used one....cheap.
You're most likely going to want to bottle at some point, there's really not much in the way of overhead of equipment other than saving up bottles or buying them. Might as well learn it now while you build up your keegging equipm
Oh, the best option, is kegging. I hate bottling with such a passion I started getting behind but I still do both, glad I learned how to bottle first.