The peach pits contain upwards of 88mg of cyanide per 100g of seeds. Not sure how much could be extracted with the fermentation but probably not worth the risk. Also the pits can add a bitter, astringent taste to the wine.
I would also remove the skins for concern of extracting tannin, pectin...