I verified that the temp stayed steady during the mash, so it wasn't that. However, now that I think about it, the wert would have cooled after it was siphoned into the pot. Especially with 2 sparge steps.
I think that I will put some heat on my pot next time to heat the wert up and stop any...