It really doesn't matter. You can add them at any time. I'd probably add them at secondary, so you can add more later if it's not enough. In fact I'd probably add it to secondary, but a bit less than the recipe recommends. You can taste it later, and add more if needed. I'm not a fan of very sweet things, so I'm cautious when it comes to sweetening wines and ciders.