I've brewed with whole chamomile flours. 1 hour in the boil. Yes, there is a noticeable flavor and aroma. If you've had chamomile tea, you know it doesn't take much time at all to get the flavor out.
BTW, the whole flowers are easily available at natural food places. Probably cheaper than the dustings you get in the teabags.