How late do you stay up? Typically it takes me something like 20 minutes to get everything together. Then it takes a while for the water to boil (how much water are you boiling and is it on an outdoor cooler or your stove?). I usually have a 1 hour boil for the hops. Then it takes 15 minutes to cool the wort with my IC. 15 more minutes and the gravity is measured, the yeast is pitched, and it is capped and put away. Another 20 min or so for cleanup (I try to do some cleanup while boiling). Roughly 3 hours for me.
I would budget 4 hours for the first time. If you are done early, great. Good luck.