You have to weigh the pros and cons for your situation:
How far along are you in brewing? If you are a beginner brewer, the aesthetics aren't as important as just getting a decent beer. If you are an advanced brewer, racking to secondary improves clarity when you aren't able to crash cool or...