Pff, I say caution is overrated. If you want to dump some herbs or fruit in, why not? 20 brews before you dare to experiment is horseradish.
A few (very) rough guidelines, based on a 5-gallon batch size:
Fruit usually goes in late. Ferment your wort, rack it to a secondary fermenter, and add...