To me it looks like moss. Possibly from that area staying wet and not drying out. That being said, I did have fungus growing and popping up in some of the mulch around the house after it rains heavy.
It is either worm poop or insect poop, maybe a harmless fungus growing in your soil (unlikely). If your plant has no symptoms, then don't worry about it.