Odds are only a small portion on the yeast got preserved. If the gravity is changing then you have propagation go on, just at a small scale.
Think of it like you are starting from a slant. (very small sample) It will come around but it will take awhile for the yeast to get the cell count up. I...