my perception of rye in terms of flavor is similar to yours but I think "spicy" comes into use because its different and nuanced. Most malts are fairly straightforward in character, and how you use them brings them out. Rye just has a unique character, and spiced may be the word people are...