When calcium ions in your water, including ones that already in the water and those you have added by tossing in gypsum, calcium chloride, or any other calcium salt, react with phosphate in the malt they release hydrogen ions which are responsible for the lowered mash pH's seen with hard water. But the dark malts, if any, contribute additional acid and also lower pH. In most cases, the sum of these is not sufficient and additional acid is required for proper mash pH. The best way to proceed is to understand roughly what mineral profile is required, establish that, mash, check pH and make adjustments with additional acid or alkali additions. There are 2 approaches to getting the initial mineral content approximately correct. One is to get your water's mineral content measured. Reducing an ion concentration that is too high is easily done by dilution with deionized water. For example, if alkalinity is 100 and you want alkalinity of 50 you dilute 1:1, for 33 you dilute 2:1, for 25 3:1 and so on. To increase an ion's concentration you add a salt of that ion. For example, to increase 50 mg/L calcium to 150 mg/L you would add 368 mg calcium chloride dihydrate to each liter of water. This also increases chloride by 177 mg/L because there is a fixed ratio of chloride to calcium in this salt. This methodology works well until bicarbonate or carbonate become involved. You cannot increase calcium by adding calcium carbonate. It won't dissolve unless you add acid. But whatever you do, the critical step is measuring mash pH and controlling it. If you get this right you will see a dramatic improvement in your beers.
You aren't going to get up to speed on all if this overnight. To get you started brewing there is a Primer in the stickies area at the top of Brewing Science. It really simplifies things and people are reporting good results using its guidance.
Finally, you should be cautioned with respect to the various spreadsheets. They do not model carbonate/bicarbonate accurately (if they did they would be much more complicated than they are), there is really only a very weak correlation between water alkalinity and beer color and chloride sulfate ratio is not a measure of maltiness vs hoppiness in all, or even most beers. The spreadsheets are fine in some cases, not in others and unless you have pretty in depth understanding of the chemistry you won't know which. The EZ spreadsheet author recognizes these shortcomings and lists many of the caveats on the spreadsheet. You should heed them.