What's the primary??? If it's a glass carboy with airlock, probably not much too worry about(just don't blow smoke at the airlock), if it's a bucket those don't necessarily seal tight all the way around, though again, even with the bucket, I wouldn't think it will be an issue unless you're blowing the smoke right at the bucket.
I'm assuming you're brewing with the garage door open?