Probably. Next time, you can try using chunk pepper in a grain bag and sink that in your primary with a sanitized stone in it. I wouldn't worry too much though. If you still have the floaties by bottling day, you can always try lining your bottling bucket with a sanitized BIAB filter bag. A cheap option are paint strainer bags they sell in hardware stores. Just boil it for a few minutes to sanitize it, use it to line the interior of your bottling bucket and use some metal binder clips around the upper edge of the bucket to hold the bag open and in place. As the beer drains out into your bottles, the bag will strain out the pepper and any remaining trub.
Beer so good, it's frightening.
2014: Seven Heavens Series One: Vilon, Mystic Melomel, Skeeter Pee.