I'll almost always put the samples back. I just make sure to sanitize the hydrometer and such really well; I haven't had any problems yet. I don't take many readings, anyway. One before I pitch the yeast, then one or two to make sure the fermentation is done. Sometimes one on bottling day just to be positive.