Brown sugar will leave molasses behind (assuming you're brown sugar is the same as in USA). It can be used to add bitterness and color, but IMO not great for sweetness.
I suspect the non-fermentable portion of raw sugar is tiny.
Depending on yeast, you could try maltose/dextrins, etc if you...