Contaminated batches come form poor cleaning and sanitation, not plastic. If you can't clean a bucket maybe you should pick up knitting instead.
I use a plastic Mr. Beer fermenter for 2 gallon batches. I don't use the valve on it and I bottle form another plastic bucket (frankly, a valve on a fermenter just scares me). That way I can measure out exact amounts to get the level of carbonation I want and I can boil the priming solution.
Everything is better with a beer.