It wasn't ideal, but you didn't really mess up. Basically you just dumped some of the viable yeast out. As you noticed by the collection of yeast at the bottom there was still plenty to be pitched. But by not chilling it first there was probably just still some in suspension that got dumped.
No worries. It's still far more yeast than would have been in a vial or smack pack anyway, so you're good to go.