Thanks All. The taste is slightly bitter, slightly tangy, but not at all sour. It's just slightly off. Someone mentioned band-aid which isn't quite right, but yes, maybe just a bit like band-aid.
I'm pretty careful about fully rinsing even the no rinse sanitizer, so I'm thinking that can't...