You'll be fine. I don't use any sort of screen either. The vast majority of the particulate settles out in primary. What doesn't drop out there is left behind in secondary.
Just to be clear, I'm talking extract batches here. I'm not an AG brewer (yet) so I don't know if that would make using a screen more important.