Yeah I do the same thing. I wait about a week and have a test beer. If the top pops and does not taste like a flat beer I put my case into the fridge and wait a couple of days and enjoy.
I have messed up a couple of my one gallons by not cooking It down to the correct temp usually 75-80 degrees F. I used the ice bath method. Now I have a wort chiller. Thing is amazing. Cost around $60. But cools a 5 gallon batch in like 10 minutes. And yes it can take 24-72 hours for the yeast...