I'll cast a different vote. I've found acceptable levels of carbonation in as little as a few days - say, Wednesday, after bottling on Saturday - so while the flavor might not be as mature as it can or will be, you may find that you at least have an acceptable head by Tuesday or so. The greenest home brew is still likely to be better than any commercial beer you buy.
Edit - don't refrigerate until a few hours before you are ready to drink - or put it in ice water a half hour before. This will let the carbonation process go as long as possible. Once you chill it, the yeast are shut down.