I usually set up the water, burner, mash tun, etc. the night before brewing, which takes about 15 minutes.
Assuming a 60 minute mash and a 60 minute boil with no hop stand, I get something like this:
heating strike water, 20 minutes
Mashing, 60 minutes
Recirculating, 10 minutes
Sparging, 40 minutes (I could improve this, I know)
Heating sweet wort, 30 minutes
Boiling, 60 minutes
Chilling, 5 minutes
Transfering to fermenter, 2 minutes
Shaking, pitching, and putting into fermchamber, 12 minutes
Cleaning, 45 minutes...
That gets me just under 5 hours, which sounds about 15 minutes longer than it actually would take. Sparging and sweet wort heating kinda overlap, so that sounds like the source of the issue.
However, I frequently do beers with longer mashes (147 for 75 minutes for Saisons and double IPAs, for example) and 75 or 90 minutes boils (for strong ales, pilsner malted beers, etc.) and hop stands (15 minutes), all of which add some time.
In light of this, I sometimes finish my sparge and heat the sweet wort to a boil to pasturize (this probably also kills a ton of DMS) and then finish the brew day the next day, or in the evening or whatever.