Your too deep... into the keg.
Seriously though, I think part of what you are saying is correct. I don't know that you are necessarily drinking all the yeast and sediment out, but it does have more time to settle out.
The other part is that some of the flavor components of the beer breakdown over time into things that taste better or are in concentrations below the taste threshold or have no taste at all.
On brewing hiatus until back problem resolved.
Drinking: Banana - Lavender Honey Melomel, Cherry Schwarzbock, Cranberry-Welches Wine, Hazelnut Sweet Stout, Moteuka Amber Ale, Three Goats Gruff Cyser, Smoked 70 Shilling Bottle Bombs.
Brewing/Drinking blog: http://beermonday.blogspot.com