If you leave them in during fermentation, you'll get more cacao flavor, but also more fat. Nibs are about 50% fat. Whether the tradeoff would be worth it to you might depend on how much nibs you used in the first place and how much flavor you're looking for.