Your fine, this is a common practice especially if you do POLs RWS (real wort starter) and use a bit of your own wort to get a starter going for the first 24-48 hours.
I brewed Saturday and had a failed pacman starter so I used some of the wort and did another starter with US-05 and didn't pitch it until Monday morning. It is doing great so far.
On tap: #79 Berliner Weisse 1.030 9/20/12, Flanders, Barleywine, Wild Blonde (1.045 blonde hopped up and fermented with WLP644), #80B rett Saison
Fermenting: #82 Galaxy IPA, #83 Black IPA
Aging: #67 Bareleywine 1.116 11/07/2012, Flanders 2 batches 1.056 and 1.060 12/12/11 and 3/26/12, Kriek, 1.052 12/11,