What hops did you use in the boil? What type of beer is this? A recipe is always helpful.
That being said, even though Columbus is a high AA% hop, it has a pungent, spicy, earthy, citrusy profile that would work well as a dry hop. If this is an IPA (I'm assuming here) an ounce or two of...