Great question, OP, and I've really enjoyed the responses. It has made me appreciate the ways I've set up my brewing over the years to enjoy the whole process with a minimum of wasted time. Things I used to hate, the lugging of heavy objects, the gathering of equipment from various locations, even the cleaning - I've just worked out over the years ways to do it without hating it. A pump, shelving, a brew stand, wash tubs, PBW - they all help make it go smoother. I think my only gripe is that I don't have running water in my garage, so I have to run a hose out for brewing water and for chilling, and there's no instant hot water, so I have to be creative when I'm trying to rinse everything. I heat a few extra gallons of sparge water, so I have some for washing up the MLT, and then I use the first runnings of the immersion chiller to fill a wash tub and rinse tub with hot water. A lot of my cleaning takes place while something else is going on: MLT gets cleaned during the boil, other equipment gets cleaned after I remove the immersion chiller and am letting the trub settle after whirlpooling.
What I really hate, though, is when I injure myself or break/damage some of my equipment. Two weeks ago while I was rinsing PBW out of my boil kettle, I grabbed the chine, which had been several hundred degrees just a few minutes earlier. The whimper that escaped my lips was more out of the realization of my own stupidity than of pain. The scars are mostly gone. It's for this reason that I never crack open a brew until the wort is in the boil kettle - just make too many mistakes.
In a week and a half, I'm going to do my first ever double brew day - so I'm interested to see how long it will take, trying to be efficient in my multitasking. Hopefully I won't break anything...