There aren't distinct boundaries between the phases of a culture. Just an average influenced by several factors.
Definitely makes sense, seems to be the way of things. I'd venture a guess that, also as these things go, there's no rule for all yeasts, each will have its own rate and some will be ready far earlier or later than others.
Still, are there visual clues in a starter? Color change, perhaps turn it off for a few minutes and look for bubbling?
I typically start my starter the night before brewing, crash the next morning, decant and pitch that afternoon. I'm certainly off to a faster fermentation than a direct pitch or a single smack pack, but always up for "better" if there is such a thing.