I bought the biggest plastic tool box I could find. It's got compartments on the top of the lid for bottle caps, Grolsch gaskets, and carboy caps. The inside tray houses test equipment, fermentation locks, and other small items. In the bottom I keep a capper, hoses, canes, spoons, oxygen regulator, and un-opened bags of bottle caps. The only things that won't fit are my auto-siphon, extra cane, and a really long spoon. Ingredients go in tubs and in the fridge. Sanitizers and cleaners stay in the laundry room.
I used to keep everything in my fermenters, until I started doing multiple batches. It's best not to store anything in there anyway. Some things can possibly scratch the plastic.