I'm doing something similar this weekend with tangerines, although adding to a keg instead of secondary.
My plan is to zest and peel the tangerines, steep the zest and fruit in a bag in a 1/2 gallon of water at 170, let cool, and add it all into the keg before racking the beer onto it.