I'd say you let it settle too long. The process can be a bit ambiguous, which why I only did that process a couple of times before I found a better way (hint: make a larger starter than needed and save a little of the slurry, which is already nice and clean, for a future starter. Lather, rinse, repeat ad infinitum).
Just pitch the slurry into your wort and it will be fine.