Honey and brown sugar will both add flavors. If you are looking for a honey and molasses flavor in the beer, keep them in. If they are just fermentables, leave them out and use more grain/DME.
I see a lot of people fall into to "kitchen sink" mentality with brewing, or get into a "hey, I just add this to change things up a bit" phase. Hell, I have too! I have since learned to brew solid beers in many categories over several years, then started changing things up; but only changing one thing at a time. I am still experimenting, but with small batches and controlled additives/yeasts/techniques. It's too easy to add things, end up going too far, and then have a beer that's not what you wanted or turns out to be a dumper.
Again, only my opinion.
"Small changes, Ellie." Carl Sagan.