I've brewed with yarrow twice now (gruit ales) and both times the bitterness was quite mellow, more of an herbal astringency than the firm bitterness you get from using hops. The flavor of the yarrow, however, was not to my liking.... think herbal shampoo and 'bus full of hippies.'
Both batches were 2 gallon, 0.5 oz of fresh yarrow at boil and flameout, while the last batch included rosemary. Better, but not by much. Good luck.