+1 on the thief. Its a must for carboys. Also make sure that your OG reading is taken from a well mixed wort, if not, the wort (which is heavier than water) sinks to the bottom and your sample, taken from the top is from less dense liquid. This results in a much lower SG reading.
Good Luck!