Thousands of years ago, when people first started brewing, they had no concept of sanitation and all of their fermenting was done "spontaneously." If they had any issues, it wasn't enough to make them stop brewing.
If anything other than yeast gets in and takes hold, you're going to notice...