Thats how I got into cider. I had my beer equipment, moved to an apartment with a stove not suitable for beer (Too long to boil even a gallon of water) and started pumping out cider. Other than a brew kettle, a nice stirring spoon, you should be set. This is assuming your not talking about all grain brewing.
THat being said, you can get a whole lot of gadgets for making beer if you want to get more advanced (Wort chillers, hop balls,...) but these things arent needed from the get go.
Primary: JAOM, RiceWine. Wine soaked raisin Apfelwein
Secondary: Skeeter Pee, Cyser, Tree Sap Cider,
Drinking: Milk Mead, Apfelwein, Grape Mead, Cranberry Pomegranate Cider, Cherry Berry Cider
Future: Strawberry/ Raspberry Cider , Apple Ginger Cider