After doing some more research I do have Japanese beetles. I have only seen a few but they are going to town eating my hops leaves.
I am going to try Neem Oil on them and see if that works.
It is organic and non toxic so they say.
I will post an update for others that might have the same problem.