taking a hydrometer reading would probably help answer this question, but the short answer is no, it should be fine. The first few days are usually the most vigorous fermentation so slowing doesn't mean anything bad.
If you take a reading and it's still really high then you might want to consider giving it a gentle stir and even warming it a bit but probably only if it's still high after a week or two. At only four days I'd say let it sit for another 3 at least, maybe even another week and a half, and then check SG. I don't know what Brandon's recipe usually gets down too but my similar malted cider got down to about 1.006 I think.