I'm currently drinking a batch where I did just that for the first time. It will settle out with the trub, don't worry. When I racked into the keg it was crystal clear and drinking out of the keg it has no off flavors.
End of the Line Brewing
Primary: Caramel Cider
Secondary: Bourbon Vanilla Porter
On tap: Some Sort of IPA, Cherry Cider
Bottled: Belgian Sour (1st place winner Binny's Chicago Comp)