You'll get better tasting beer. Patience is one of the hardest brewing skills to learn. Personally I have eliminated secondaries for most of my beers. I ferment ales for 3-4 weeks and lagers 4-6 weeks in the primary. Really big beers go to a secondary for 2-3 months of bulk conditioning.