Referring to the starter beer tho, which has fermented at this point. And the off flavors of that fermentation (whether due to high temps, continuous aeration, whatever) are already there. Then combining that with fresh wort, I think those flavors (though much diluted) would still be present.
I dunno, I've tasted the decanted starter beer before and sometimes it does not taste great. Like I said, it hasn't dissuaded me from still pitching whole starters. Sounds like a good side by side experiment. For someone else to try that is..