I usually only have yeast/sediment it in my first 1-2 pints off a new keg. Although it wouldn't be hard to do, I usually try to avoid modifying anything if I can. You can try and pick up less yeast when you transfer to kegs. Do you happen to cold crash? That helps. Or you can invite a buddy over that doesn't mind.
Honestly though I've only had it give me some bad farts but that's pretty much the extent of it.