Not sure if you're treating your water or not, but adding too many sulfates (gypsum,epsom salt) to your water can cause more of a rougher/harsher bitterness. First wort hopping, as was mentioned several times already, will definitely provide a smoother bitterness, but I would also think about...