You can do either, you could even drink it now if it tastes good. I drank a couple of pints of mine at bottling time and it was good, but it does taste better after aging a bit.
The 3 week rule is for carbonation. These are bottles that you're not trying to carbonate, right? So all you're really doing is aging (conditioning). You can pull them out of the fridge if you want, or leave them in - because you didn't prime them for carbonation they don't require the 3 weeks at 70 degrees. They will likely get better as they age though, and I think they will mature faster at room temp.