Gas - liquid equilibriums are complicated when not in balanced system, and I am by no means an expert on the topic. But, to me, there is no magic in CO2.
If I take a growler and fill it from a tap with liquid that contains, say, 2.5 volumes of CO2 at a given temperature, it's very quickly going to reach equilibrium with a certain amount of head pressure and just short of 2.5 volumes of CO2 in the beer itself. Assuming it's properly sealed.
So, let's say I add priming sugar sufficient to reach 2.5 volumes of CO2 at the same temperature to an unprimed growler with the same amount of headspace. When it's all said and done, there's the same amount of CO2 in that bottle, and the head pressure is going to end up being exactly the same, right?
Now, there are some problems with that analogy. First, head pressure is dependent on temperature, and you usually bottle condition at a higher temp than you keep a filled growler. Is that enough to explode? I doubt if I took a growler I got filled from the brewery and let it reach room temp it's just going to blow up. But, hey, I've never tried it.
Second, if you overprime, or have admixture of the sugar, *BOOM*. So don't do that.
Third, I'm not sure what effect the gradual increase in gas pressure from bottle conditioning has on the container.
Personally, I'd be perfectly comfortable doing it.