When I look at substitution of malt as something doable I ask myself, "Am I going to enter this in a contest or am I brewing for myself?" If it's for myself, I substitute.
As far as what flavor will the omission of vanilla in my malt be to my brew? A stout is pretty strong beer. I don't think it'll be missed.