After the bulk of vigorous fermentation. Basically when the ferment starts to slow is when you can be less concerned with rising temp. This is usually after the third day or so with ale yeast strains but can depend on yeast health, pitching size, pitching temp, aeration/oxygenation, lag time...