you should be fine, berries and fruit should be boiled before entering the fermentor after the primary to scurb any wild yeast on the skins, i have used coffee and hops without steriliaztion and have had no off flavors at all, if infection is a worry dip your hands in isoproply alcohol or just some one-step, overall the secondary can handle the hops or spices, cause the bulk fermentation has finished and your flavors are pretty much locked in, only problem would be wild yeast or over oxidation neither should pose a problem in the secondary.