With practice you can go from setup to cleanup in 4.5 hours. You just have to be efficient about it, not drink too much, and it honestly helps to brew by yourself so you don't have to entertain somebody else.
Here are some ways to save some time:
-The day before brewing you need to run through your equipment and ingredients to make sure you have everything you'll need.
-Instead of starting the brew session by spending 30 minutes setting everything up, start the mash first. Once you have the mash going, then you can get all the rest of your equipment set up.
-While you're lautering, prepare your hop additions.
-While you're boiling, clean the mash equipment, sanitize the fermenter and hoses, etc.
-During the chilling process, do more cleaning.
I think the biggest time suck for most people is thinking they have to perfectly set up everything before they even turn the heat on. I remember when I started brewing I would spend at least an hour or more setting up, cleaning and sanitizing everything, setting up tables and chairs, putting all my equipment in the garage, etc. My extract batches were taking 4 hours this way.
Not drinking and not brewing with friends are unfortunately the easiest way to speed things up but of course we all know these are also two of the most fun things about brewing. So I suggest trying some of my methods by yourself until you get into a routine, and then you'll be comfortable inviting people over, and maybe having a beer. I still don't start drinking until I'm at least boiling, but usually not until the cooling.
I don't recommend the split method, where you mash one day and boil the next... I think there's too much room for error, although theoretically you could make it work. I think concentrating on your efficiency should be your first step.