So you've only had the beer on the CO2 for a week? If so, give it more time. I've found that my kegged beers take 2-3 weeks minimum to carb correctly and taste like they are supposed to.
That strange off flavor you're experiencing is simply young beer flavor. I don't know what its called or exactly why it happens (maybe a veteran brewer with more knowledge than me could jump in here?), but just give it another week in the keg and it will taste 100% different the next time you try it.
I personally found that my beer tastes "ok" at 2 weeks after kegging, but just right at around 3 weeks.
I'm actually sampling a glass of my IPA that's been kegged for 11 days now and its definitely not ready yet. I plan on not tasting it again for 10 more days.
I'd love to hear how commercial breweries deal with this. It takes me a minimum of 5 weeks to get beer done and tasting right (2 weeks fermenting, 3 weeks kegged). It seems like they are able to turn their beers around much faster?