Was the brown sugar part of the recipe??
Adding brown sugar would have raised ABV and dried out the beer. This would have possibly thrown the malt balance and bitterness balance out of wack if it were not part of the original recipe. Adding simple sugars that aren't in the recipe is about the same tossing in a few shot glasses of grain alcohol. Seriously....if the recipe doesn't explicitly call for it, there is rarely a good reason to add simple sugars to any brew.
That said, leave your beer alone. It is not done. You can't judge the final taste of a chilled, carbonated beer based on a warm, pre-carbonation sample. The beer is going to change a ton between now and when it is complete. Be patient and send it through the entire process, then judge it.
If it were "contaminated" it would be souring and pellicle would start growing on the surface. It is doubtful you are contaminated, just impatient!!
Anyway, finish this one out, give it proper time to condition and carbonate, get it down to serving temps, THEN judge the beer. Even if it isn't the best beer ever, it will be beer, and anything that's a little off can be a learning experience that you can fix in your brews going forward. Trust me, it takes quite a few crappy batches to learn how to make consistently good batches!!
Good luck!