Along with RM-MN's Quaker Oats analogy, remember that light is also an enemy of maintaining freshness in your grain.
Obviously, the sooner you brew after milling the better, but you should have no problems with spoilage during short term (6 -8 weeks) storage of grain in a cool, dry, dark place.