I don't even keep mine in the fridge. I buy bulk, and they're all stored in big plastic tubs that I bought from home depot. As long as it's airtight and there's no moisture, you'll be good. I would say that since you've already got it in the fridge, leave it there. You don't want it to get to room temp and develop moisture in the bag. Next time, just seal it up and stick it in a cool dark room (maybe with your conditioning beers).