To address a couple of issues...
Many of the flavors produced by yeast come during yeast growth. If you repitch onto an entire yeast cake, there will be very little yeast growth (since they already reproduced a lot). How important this is depends on how much flavor your particular beer gets from the yeast. So a bigger deal on something like a belgian beer where yeast adds a lot of character vs a clean fermenting eyast.
Pitching onto a secondary cake does result in a cleaner yeast cake, because you left most of the trub in primary. However, you are pitching onto a yeast cake made up of less flocculant yeast. This is because the moer flocculant yeast flocculated out in primary. So your next beer may take longer to clear and have more yeast make it to bottling because of the selective pressure you put on your yeast population by only using what made it to secondary.
If you pitch onto the entire yeast cake, vs pitching only a portion, you will have a larger percentage of dead cells in your next ferment. This ties back to the lack of significant cell reproduction when you repitch on an entire cake. As an example, lets say you pitch a 100 billion cells in your initial ferment, and they reproduce to where you have 800 billion cells in your yeast cake at the end of the ferment (i don't actually remember how much multiplication occurs in a 5 gal ferment). So now you have 800 billion cells in your cake. and lets say you haev 90% viability, so 80 billion of those are dead. If you repitch on that yeast cake, you're starting with 80 billion dead cells which will continue to be dead. If you take a quarter of your yeast cake, 200 billion cells, 20 billion of those will be dead. Pitch that, it reproduces to about 800 billion cells, so you end up with the same final amount of yeast to do your work, but a much smaller percentage of them are dead.
I'm actually in the middle of listening to an interview with chris white of white labs, so all this is kinda fresh in my head.