Check the nut on the grinder (the one that goes after the wheel, towards the outside). It should have a ridge on one side, and be flat on the other. Typically, you can flip it around and use it whichever way you need in order to secure the disc/wheel you're using.
What grinder make, and model, did you get??