You should have made a starter 2-3 days before pitching. If you are using vials of liquid yeast (White Labs), you will definitely need a starter. I am guessing that you underpitched and you are experiencing a long lag time. This may result in some off flavors as the battle rages right now in your wort between the good guys (yeasties) and the bad guys (nasties). If your yeast works too hard, it may produce some bad flavors.
You have two options - 1) wait patiently, relax, and have a homebrew, 2) pitch a packet of dried yeast from your homebrew emergency kit . . . .
. . . .er. . . .you do have an emergency kit, don't you . . .
I am guessing that your beer will be fine. You are just in a long lag time after pitching so little yeast.