So, after thinking about it and doing some research, I'm going to do the following. I will boil orange peel, vanilla bean, cinammon, and ginger to make an extract, then add the extract to taste when I rack it to secondary. I will also add a bit of oak then, because, well, why not?