fruit fly

So I know when fruit flies get into your brew, it's game over for that batch. I'm wondering how to know when it's game over. I saw fruit flies around my brewing jar and hanging out on top of the cheesecloth, but I haven't seen any inside the jar. I've checked inside and I don't see anything...