I'll bite: It's fine, no big deal.
Ok, seriously, it'll be fine. Take it out of the freezer after work and try to get it warmed up before pitching. Also, rehydrate that yeast (assuming dry) to make sure they're truly awake. Expect a longer lag time since the wort will likely still be kinda cool when you pitch, but don't worry they'll get going eventually.