Yes, I basically peeled the fruits, removing all of the pith manually with a knife. Like I said, I took my time. It was most likely unnecessary to take it that far, but I wanted as much of the citrus to extract as possible in the boil.
Sniffs from the airlock provide a nice hit of citrus...