What yeast did you use in the starter?
If it was Wyeast or White Labs, or similar, then the timing sounds good. If you are starting from a very small amount of yeast (as from a naturally conditioned bottle), you may want to put off the brew for a week or so.
You can see if the yeast is active by swirling the starter. It is a good idea to do this every hour or so (or whenever you think of it). If the yeast is active, it will release some CO2. The other way is to keep checking on the amount of sediment. If the yeast is active, the sediment (yeast) will grow.