I think that if you can chill your wort down to about 68º or so before you pitch your yeast, you'll be totally fine. The yeast will get cooler temps during its growth phase, since it'll take at least 12 hours for the wort to get up to ambient temperature. Once active fermentation starts, esters aren't really much of a problem.
I've done two batches this way (it gets warmer in the summer for me); one a golden ale and one a stout. I used 2L starters to minimize the amount of growth required, and I can't detect any esters or clove-like flavours.
If you listened to last weekend's "Sunday Session" on the BN, the White Labs people talked about their home brew setups. They're in San Diego, rarely use temperature control, never use starters and brew beer that they're happy with. And I bet their bar for "happy" is higher than mine.