I do it all the time.
I often don't know that I'll be brewing until that morning, so I don't get to make starters too often. Definitely will help to pull the yeast out when you start brewing and let it get up to temp. I tend to over pitch when I do this too, I guess I figure it will have a better chance of having the correct amount of viable yeast.