I will reiterate what everyone above me said and say bad idea. It can be done, but really shouldn't. Not to mention the fact that since you do not pour an entire growler in one go you will pull the conditioning yeast sediment back into solution after your first pour and will not have the beautiful clear beer you would otherwise from a smaller bottle.
I take it you are not enjoying cleaning/delabeling/capping the multitude of bottles. I would suggest switching to 22's or kegging. Safer, less work, though kegging is more expensive in equipment and less sharable until you start bottling from the keg or filling the growlers from there.