You are correct. Most caramel does not ferment, but I don't believe the amount of caramelisation that can occur in the boil (small) would have any impact on fermentability. Our eyes are very sensitive to color changes.
Unless you scorch it.
Remember one unassailable statistic, as explained by the late, great George Carlin: "Just think of how stupid the average person is, and then realize half of them are even stupider!"
"I would like to die on Mars, just not on impact." Elon Musk