I usually see very little in the secondary (when I do a secondary) but I do see some - although it's so light and wispy that it takes no effort to stir it up.
When you rack from the primary, there are all kinds of solids besides yeast cake - proteins, hop particles, etc. With 99% of that left behind going into the secondary, there is less to clump together.
If you have a method of cold-crashing for 24 hrs or so before siphoning to the bottling bucket, you'll see more.
no worries, however. 3 weeks in the bottle to carb up, then a couple of days in the fridge and all the particulates will settle out to the bottom of your bottles.