Allergies are very funny things. Like you, I'm not allergic to poison ivy, oak, sumac - none of that stuff. However; my wife and daughters are not so fortunate. One of my daughters - athletic as anything, even through college - is (in our jesting) allergic to life. I'm an old country boy and very adventurous about trying new foods - even wild stuff, but she is SO sensitive to things that she has to be very cautious as much as she wants to follow me.
Don't take this as medical advice, or necessarily even expert advice, but something we were given to do somewhere along my path of life to test for sensitivity especially for new stuff was:
1. take the part we wanted to consume (fruit, leaves, etc) and rub some of it on the soft skin on our wrist. Wait for 20 minutes to an hour to see if it affected us. (I've since learned from my daughter that an hour may not be long enough).
2. if the first part turns out okay, if it is something you want to eat, try putting a little bit on your lips and wait to see if you get a reaction.
3. If everything is okay to this point, you may put some in your mouth for a few minutes and see if you get a reaction, or if it is pleasant in your mouth.You have to give yourself time to react if you are going to (with 2 steps in front of this one before you put anything in your mouth).
4. If everything is okay on those first 3 tests, then you might try eating a little bit of it and see if it causes a reaction. You do want to go slow, though, even if you don't have a reaction on the first one.
Now a couple of things I've learned might be wrong with that process:
Mangoes will cause a reaction on my wife's lips, but this didn't develop until later in life, and she absolutely loves mangoes. As funny as this sounds, if she is careful, and doesn't get it on her lips, she can eat mangoes with no reaction.
And from my "allergic to life" daughter, we've learned that sometimes your body may take a week to ten days to sensitize before an allergic reaction becomes apparent. Be sure to pay attention when it happens, though, because the second time is almost always much worse than the first reaction.
We've also learned that acidic food causes reactions in a lot of people. I'd check it out closely and be very careful because if you really had an allergic reaction to something in the grapes, then the next time could be much worse for you. It's probably worth seeking medical advice or testing if you are concerned about it.