What's going on is, your fridge is too cold for the yeast; instead of staying active and turning the priming sugar into CO2, they flocculate -- go dormant and sink to the bottom of the bottles.
This is also known as a "cold crash" when you do it to a whole bucket or carboy; most remaining active yeast flocculates, so the brewer can rack off a very clear beer for kegging/bottling/whatever.
But, yeah, you'll need to swirl them to get the yeast that's settled to the bottom back into suspension, and let them warm up to temperatures where the yeast will get to work on that priming sugar instead of just flocculating again.