The best time is when it's reached it's FG and has been stable for a few days. I like to wait 2 weeks myself, but I still check to be sure that FG has been reached before I move the beer.
True, a secondary isn't necessary for most styles but I prefer to use one because it frees up my primary vessels, and I also dry hop more than half of my beers. I also get a really clear end product.