I think you will be OK. By just pitching the vial it may take a good 24 or more hours for the yeast to reproduce enough and start to ferment. Keep it in the temperature range and I bet it will start pretty soon. What you might plan on now it another brew right on top of this one with the yeast growth you will have at the end of primary. I just did this for the first time today and within 1 hour it was pouring out of the blow off tube and churning like mad in the carboy. I knew it would start fast and strong but not quite that fast.