I agree, don't worry. Sure, not ideal but as long as things are clean and you don't have lots of dust and dander being stirred up in your brew area, you'll be fine. We've all had less than ideal brewing situations at one time or another and most all of the time we're surprised at the end result of the beer being just fine. I think if you have high standards that you try to keep (and it sounds like you are on that track) then one small slip like this won't have a big impact and you'll still be fine.