Try an acidic solution. Beer stone is a stone, calcium oxalate the same thing that makes up kidney stones. Household vinegar may soften it up and if not buy oxalic acid from the hardware store.
Just curious, how did you end up with beer stone in a carboy?