I looked at the manufacturer for the cheap $2 buckets from farm n fleet, turns out almost all their buckets were food grade accept the ones made from recycled plastic. Check the manufacturers website, though if its the orange ones from home depot I can tell you those are NOT food grade.
I duck taped the lid down on my $2 bucket after filling with apfelwein. Not my proudest moment but I was in school and had lots of friends drinking from the corney and not enough fermentation vessels. No, I couldn't taste the difference.