Keezer / Fermentation Chamber?

I have a 7 cubic foot chest freeze, that I'm currently using for my keg and other bottled beer around 38 degrees.

Unfortunately my old fermentation fridge kicked the bucket, so I no longer have a separate fridge for that. I don't really want to buy a new fridge and temp controller at this time.

Is it going to hurt the beer that's in my fridge if I bump the temp up to 65 for a ferment for a couple weeks and then cool it back down once I get it in another keg?

I have done it and it changes the taste of the beer to me but my wife said she could not taste the difference. It also changes the C02 amount in the beer.

Thanks! Sounds like it's probably best to go look at Craigslist for another fridge!