Yeah, make sure you get it up to a boil. And it's best to add the DME slowly so it doesn't clump. Otherwise if you just dump it all in at once you can get a sticky ball of DME that's a bit of a pain to break up.
Either way, as long as you get the water hot enough and stir frequently and try to break up the clumps they will eventually dissolve.