I have done that in the past without issue, in the summer when it was to hot or couldn't get to pitching it right away and in the winter when there wasn't any outside water available.
In the summer if your tap water consistently isn't going to get you to pitching temps, you might consider a...