You don't have to worry about pitting the aluminum?
Not with a wire brush you don't.
And aluminum will not pick up carbon steel and start to rust. Stainless can and once it starts the only way to stop it is to passivate it.
Pitting in aluminum will be an issue if you use acids or strong bases on it in a careless manner or an overly strong solution. But mechanical abrasion will do nothing to harm the metal unless the person loses his mind three stooges style and grinds a hole in it.