First, you're drinking green beer. I assume you're following the directions in the ingredients kit. That's your problem. I always do 4 weeks primary ferment, no secondary and 4 weeks botle conditioning. Yes, the beer will reach FG after 2 weeks. However, the yeast also produce esters that are not desirable during primary ferment. During the remaining fermentation, they consume those esters. Think of yeast as really considerate frat boys. They come to your hhouse, eat all your sugar, poop, pee and copulate all over the place and then the next morning they scrub your house clean. You threw them out before they had a chance to clean up your house (beer).
If, like most new brewers you are anxious to taste your beer, by all means do so. In fact, sample a bottle each week to help you understand the effects of time on you product However, please set aside at least 1 6pak for the 4 weeks I recommended.