While I agree to a point, it is true that the master chef will often emulate simpler rustic cooking, but he still masters the more advanced techniques of cooking, so when he doesn't use a technique he has a good reason. A free-form jazz musician does not simply discard music theory, because his music sounds fine without it. He may lay those restrictions aside, but to make the best music he still masters them. A poet who doesn't feel bound to standards of poetic form, still learns and masters those forms so when he deviates from them it is for a purpose. A brewer who masters the techniques of brewing and then chooses to lay some of those techniques aside is an artist who has a specific reason for using the tools at his command. Is this anywhere close to the one who says, "My beer is fine so why try harder?" While I am all for someone saying this of their own beer, the problem is that when you post such things on a place like HBT (which you are free to do) then you actually cause problems for those who are trying to learn good brewing. "This guy doesn't bother with building a starter, but simply pitches low, so why should I?" For that reason, others must step in and point out that while your choice is your choice and the beer may taste good, this is not good practice and not the practice of someone who wants to make the best beer.
What kind of brewer do you want to be? I don't care about contests and don't care about being better than everyone else. I shoot to be better today than I was yesterday--I compete with myself. I also want to be proud of my beer when presenting some to a friend.
Do an experiment. Make two identical 5 gallon batches. In one batch pitch a single vial of yeast. For the other build an appropriate sized starter (take the time to calculate it). Ferment them out the same way and see what happens. Then decide if you need to use starters. Until you do this, you are only guessing. By the way, you may want to check out the book Yeast, by Chris White--of White labs.