Pretty sure I've had the same issue. Gone through the same process as you trying to pinpoint it - I've never had an infection in fermentation, nearly all of my batches (over 8 months of AG brewing) have tasted excellent (imo) - or at least what I was after or expected - out of the fermenter...
