Yes and no. I honestly don't think you're going to taste a huge difference as long as you get the AAUs right. Different hops do have different other chemical properties (other than Alpha Acids) that give them different bittering properties: some are harsher, some are smoother.
I have done exactly what you are describing with Columbus hops in several beers and have never been unhappy with the results.
Maybe if you taste tested both side by side, you'd taste the difference. Or maybe not.
Bottle conditioning: Robust Porter
Drinking: Saison Dupont clone, tripel
Coming soon: Columbus APA, Rich Red ale