Yes, that would be an issue. You want a nice steady temperature, not fluctuations. You do the primary ferment around 50 degrees, and the lagering in the 30s. If you're doing the primary, and it fluctuates, the yeast might not want to do their job.
Broken Leg Brewery
Giving beer a leg to stand on since 2006