Don't worry about it, you can pitch it without it swelling - it might take just a little bit longer for it to take off on fermentation. I did the same thing about 2 months ago, and I'm drinking a pint of quite possibly the best beer I've made thus far. RDWHAHB
And if you're not making a starter, you'll want to aerate your wort as much as you can to help with reproduction. Pour it, stir it dizzy and shake it like it owes you money!