If you're new to brewing you might want to keep it simple and skip the fruit and spice for now. Just sayin'.
If you're really set on it, though, then the answer is, as always, "it depends!"
If you're going to add whole fruit or fruit puree, you want to add that in a secondary or your primary fermentation will blow all the aroma away. Throw it in your secondary vessel and rack on top of it.
If you're going to use orange rind and for spices in general, some people add it at the end of the boil and others steep it in the secondary. You just have to be careful with adding it to the boil since all the compounds that add flavor are rather volatile and can boil away very quickly.