In my experience with hibiscus (not in beer, just in general) a little goes a long way. I know I'm fairly sensitive to it as well. As the other poster mentioned, it's tart, but I get a tannic-like mouthfeel as well. I would def only add 2 oz, and as you mentioned would add it later in the boil...