The Victory will give your beer a very toasty, biscuity character with little sweetness. The Vienna would have contributed more of a rich and malty character. It's definitely going to be a different beer than originally intended, although I personally like a little toastiness in my IPA's.