worst part for me... hmm.. would have to be trying to carve out a window to brew, transfer, or bottle. I'm just so freaking busy all the time (work, house, wife, family, etc.) that it's difficult to find the time to brew beer. I can find 20 minutes a night for sampling easily, but a 4-hr window to make a batch? (sanitation, brewing, clean-up) is very difficult, a 2hr window for bottling (sanitation, bottling, clean-up) is easier but gets pushed to the way-side on the weekends because of what I will call "house stuff" or "car stuff" (do my own maintenance); and come this spring I need to spend time splitting wood to recoup what I used this winter.
FINDING TIME that's the tough part for me.