As with most things, I'm sure the problem is in the dose. Sweetening baby formula with it (eating it every day, multiple times per day, in early development stages) is way more problematic than a brew (which by definition will dilute the syrup) consumed a few times per week.
But, it's something to keep in mind. It may be worthwhile to sub in sorghum syrup for those hoppier beers where you won't notice the "twang". Or, use a mix of sorghum and BRS to reduce the ppm.
I would imagine that the rice syrup solids would have a similar problem.