Yeah, PVC might be your best bet here. You might want to insulate it a bit, too, just in case.
Separately, I wonder if you could build the cabinet without a bottom, so the mini fridge could slide in and out (you could even put it on casters). Might be easier if you need to clean it or adjust...