ok, third attempt at an answer… (two login failures)
What ought to be the cause of any concern, IMHO, is hop debris clogging your bottling wand or getting into the bottles at the bottling stage. This concern can be mitigated by taking various steps along the way to minimize how much hop debris gets carried along with each transfer. We tend to go from the kettle, to the primary, sometimes to secondary, to bottling bucket to bottles. Hop debris won't affect the taste of the beer or final product, unless it finds its way along that path into the bottles. For me, the biggest concerns are that your bottling wand will get jammed up in the bottling stage, and more importantly, that any getting into the bottles will cause 'bottle gushers' when you open a bottle that has hop debris in it.
IMHO the absolute best method, as its easy as hell and extremely efficient, is to cold crash the primary fermenter after fermentation is complete. Do it for a few days. If you're not familiar, the term "cold crash" means to put the vessel in the fridge and let it get cold (35-40F range). This will compress the trub and hop debris to the bottom and significantly reduce how much trub and hop debris gets accidentally transferred to the bottling bucket. However, it obviously requires a fridge that you can dedicate to home brewing.
If you don't have a fridge, then the next best method (IMHO) is to add the extra step of transferring to secondary fermenter after it's done fermenting in the primary. This extra step will also minimize how much hop debris accidentally ends up in the bottling bucket and in the bottles. However, the trade off here is that it's more work, and you increase your odds of oxidation and introducing infection (however minimally).
So, the short of it is this:
If you have a fridge you can dedicate to home brew, then cold crash your primary for a couple of days before transferring to the bottling bucket. If you don't then don't bother using a secondary this time. If you do notice in these few batches that your bottling wand is getting clogged, OR that you end up with some bottle gushers from hop debris in the bottles, then next time try adding the extra step of transferring to secondary and see if that works for you.