French Pressing My Coffee Stout?

I brewed my triple coffee stout 4 days ago and I'm thinking of a way to remove all of the coffee grounds that escaped from the grain bags. I was thinking about french pressing it. Either constructing something to press it in the bucket, or pressing a little bit at a time.
Has anybody ever done this or heard of this. Will it have any ill effects on the beer?
I also left all of the coffee grounds in the bucket while fermenting. Should I have taken it out after the boil?

Thanks for the help!