It should be just fine. Meant to also stick in aquariums, and if it is not going to hurt fish then it isn't going to hurt your beer.
Good way to test if you are uncertain; clean the vase fillers, stick them in a glass of water, and wait a couple hours. Taste the water. If it tastes off, then the marbles are a no-go. Otherwise, go for it!