Plenty of us use brass fittings, and have not pickled it.
It really depends on how long the wort is in contact with the brass. In my setup, its not something I'm worried about.
Primary: English Mild
On tap: Pale Ale, Lancelot's Wheat, English Brown Ale, Steam Beer, HoovNuts IPA
Bottled: MOAM, Braggot, Raspberry Melomel, Merlot, Apfelwein, Pyment, Sweet mead, Cabernet
Gal in 2009: 27, Gal in 2010: 34, Gal in 2011: 13, Gal in 2012: 10