Actually the best temp for your starter would be about 85-100F. So you are OK. Above 105F and you have problems.
Best to chill and decant the starter before pitching, especially if you grew your yeast at elevated temps.
When you introduce your yeast to the beer, try to match temps between the yeast and the beer before you pitch.