if the starter smells and/or tastes truly foul, you'd be foolish to use it. starters often have pretty different smells due to oxidation or other causes. I commonly get some acetaldehyde from a starter, probably due to the high yeast-to-sugars ratio. these are still fine to use, and don't have the same characteristics in the batch of beer.
If it's off the wall funky, dump it.