This comes down to personal preference. People say that it all drops out in fermentation, and that's true. But I BIAB and use a hop bag, so filtration is basically automatic. I have done it both ways, and I don't think I expend a significant amount of effort to filter, so that's the way I have naturally been leaning.
There is also something to consider in the type of hops being used. Leaf hops will cause much more loss to absorption than pellets, so filtration might help get more beer in the carboy, which is always good.
Bottom Live: Either way works fine. Do whichever is easiest/yields better results for you.