Don't give up yet! Cidery beer is often cause by being impatient, or not treating the yeast they way the should for best results. Yeast will go bonkers at the wrong temperature for beer production. You need to keep the temps in a range that is not optimal for speed, but rather for producing the best flavors. Generally that means targeting the lower end of the strain's temperature range.
It could also be just young beer. If you chill the beer before the yeast has a chance to clean up after itself, then you might be risking getting certain off-flavors. Here is an excerpt from How to Brew, the online version:
Acetaldehyde
A flavor of green apples or freshly cut pumpkin; it is an intermediate compound in the formation of alcohol. Some yeast strains produce more than others, but generally it's presence indicates that the beer is too young and needs more time to condition.
I do recommend trying a few things to improve your brewing results.
First: Try a quality kit from one of the big supply shops, like Norther Brewer, Midwest, Homebrew Supply, etc. They have lots of customers, and the ingredients are going to be fresher, and they get a lot of feedback on the beers made with those kits.
Second: Use only good tasting water with no chlorine/chloramine. Chlorines will react with the fermentation process and cause phenols, which results in a plasticky flavor. If you are using tap water, try a batch with spring water bought from the store.
Third: Fermentation temp. Control your temps to keep them close to the optimal range. Maybe use a Swap Cooler or something if you haven't tried that yet. They are cheap to set up, and not a lot of trouble to use.
Fourth: Pitch plenty of ACTIVE yeast. Kits are often handled in suboptimal temps, which can greatly reduce the number of viable yeast. For anything less than 1.060 you can probably get away with a single packet of dry yeast. Anything over that and you might consider pitching 2 packets. It's better to err on the side of too much yeast. This will also shorten the time it takes for the yeast to ferment the beer, improving the chances of not getting off-flavors. If you use liquid yeast, build a starter.
I noticed you said you were brewing a "pilsner". If you are actually using lager yeast, then you must pitch a TON of it. Lager beers generally work best with a lot more yeast then normal. Ferment mid fifties for like 3-4 weeks, then raise the temp for a few days to allow them to clean up a bit (D-rest), then lager at just above freezing for a few more weeks. Unless conditions are perfect, lagers can take about twice as much time as most ales.
That should be enough for now. Brewing isn't exactly difficult, but there are some things you can try to improve from where you are now.