i bet its ink from the labels, staining the plastic.
+1 vote for an acid cleaner. Star-san soak might work well.
Primary: English Mild
On tap: Pale Ale, Lancelot's Wheat, English Brown Ale, Steam Beer, HoovNuts IPA
Bottled: MOAM, Braggot, Raspberry Melomel, Merlot, Apfelwein, Pyment, Sweet mead, Cabernet
Gal in 2009: 27, Gal in 2010: 34, Gal in 2011: 13, Gal in 2012: 10