I've done both ways. With and without a starter. Best results are going to come when you make a starter. This will decrease your lag time, and therefore give you better chances for a successful brew. I've found that most smack packs call for a starter on the instructions, but lets be realistic here, you don't always have time.
Good luck!