I have found that dextrose is actually much lighter than granulated sugar. Using a digital scale, I found one cup of dextrose to be 135-136g or 4.76-4.8 ounces per cup (compared to granulated at 184g or 6.5 ounces per cup)
To answer the OP:
2 ounces of dextrose would be about 0.418 cups or 1/3C + 1Tbsp + 1tsp
4 ounces of dextrose would be about 0.836 Cup or 3/4C + 1 Tbsp + 1tsp + 1/8tsp
As a side note, my LHBS beer kits call for 3/4C of dextrose for priming a 5 gallon batch, which is very close the 4 ounces above.