Yes it will be fine. I do it all the time ("no chill" brewing). Better idea would be do pitch yeast when batch #1 is at pitch temps.
Commercial brewers also do it- my local brews one day, puts it in fermenter [it fills only half-way], adds yeast, brews on day#2 to fill fermenter.
Fermenter...