So to sum it all up there is no right or wrong answer, BUT there are good practices to follow to produce a better beer. There is no one saying that pitching to little yeast can make a bad beer, but you do risk straining your yeast causing a lower attenuation rates which can lead to "off" flavors...