From the horse's mouth.
From the Wyeast FAQ website:
3. Does the package need to be fully swollen before pitching?
No, The package can be pitched before activating, or at anytime during the activation process. The activation process "jump starts" the culture's metabolism, minimizing the lag phase.
Smacking though fun, is never really necessary.
Making the starter is all that matters, not whether or not the pack inflating. It's fine!!!
There's no need to start with a smaller starter or anything. Just proceed as normal.
Heck I rarely even bother waiting for it to inflate, I pop the nutrient pack, give it a shake, and dump it into my starter wort. Saves waiting.