Honey will help dry out the beer, which is usually a plus to accentuate the hop flavors!
If you still want to retain *some* of the honey character, I would add the honey during whirlpool .. preferable once the wort has cooled to about 120-F. At least that's when I do it. You could also add it post primary fermentation or in the secondary. Honey is naturally anti-microbial and safe to add at those points.
I like honey @ 10% of fermentables to give just a nice hint of honey to a brew. 1# in 5 gallons or so.