I doubt that sitting on the hops in the fermenter for 10 days is going to pull any undesirable flavors from them. From what I have read and heard, "sour" tastes are usually the result of an infection, not something that comes from hops.
Here is a description of various off flavors and what can cause them:
How to Brew - By John Palmer - Common Off-Flavors
How old is the beer? I'd suggest letting it sit in the bottle for at least 4-6 weeks before you make any judgments on the taste. If it's a young beer, the taste could change significantly in the next few weeks. Spice beers can change even more than other beers over time as the spices mellow and meld with the beer.