Yeast "bite"? Pshaw. Hogwash. Maybe if you use like 3 quarts of pure slurry and don't do a secondary clarification...maybe. But normally the "yeast bite" is from something else. Under normal conditions, you'll be fine. Think about how many yeast cells are in a beer when you pitch onto an existing cake! Lots and lots.
As for your beer "not fermenting all the way" with too few, that's not really 100% true either. Attenuation is dependent on many factors: aeration, yeast nutrients, temperature, the strain of yeast, the age of the yeast, etc. I think aeration is the biggest factor besides the strain of yeast in question.
The biggest problem you get from using too few yeast cells is a long lag time leading to possible contamination.
I usually make a 2 liter starter with 6 or 7 ounces of extract for my starters. You can harvest whatever you want, but I'd use at least a pint of slurry. Otherwise, if it's new, the pitch the whole package/vial into the starter and give it 2 days.