Ok,
Listen to me carefully because this is terrible! The Yeasts are your troops and you have foreign invaders, if not directly by the way of the Ninja. You need to go your local video store and get "Honey I shrunk the kids". Study it, learn it. Next build yourself a shrink ray and don't forget to bring your weapon - I tell you, you do not want to get into hand to hand combat with these nastiest. Jump into your brew and save your creation and hopefully do this before you re-size.
---
P.s. Just kidding BUT you never know the outcome. You might of gotten away with it because the closet blocked any direct air flow and you are probably passed the main fermentation phase but you will encourage growth, so I wish you luck. I would say, just let time tell - if you get a scum later - then is the time to dump the brew but until then, pretend as if it never happened.