When I've needed to drill out a bung or other type of stopper I have always had good just using a drill press and turn up the speed as high as you can. Then as you pull down let up every 1/4 of an inch then repeat until you are through. The high speed allows for a cleaner cut and the many pauses...