You will get mixed opinions on this, but I think you will be fine. Trub can supply some nutrients to the yeast in your beer, but if you did everything correctly with your yeast (i.e. pitched enough healthy yeast, aerated properly, correct temperature, etc.) you should be fine. There will be plenty of break material that made it through your strainer and it will supply more than adequate amounts of nutrients that the yeast require.
I strain when racking, too, but it is something I don't ever worry about much.