Maybe try using a floor scraper and if that doesn't work, a concrete sanding block. That's probably not the exact term for the product but it's a sanding block made out of sort of a rough stone specifically for masonry work. I used one to sand down the seams on the wonderboard for a granite...