Could you describe the off-flavors you were getting?
Four days is extremely young; even if the fermentation seems mostly complete, there is still quite a ways to go in the beer's development. There's simply no way of knowing how the beer will change with time. I would add that four days seems terribly fast for a kolsch, which is usually fermented at the cooler end of the ale range and then lagered (when possible). What fermentation temperatures were you getting, and did you have any kind of temperature control? I for one would hesitate to brew a kolsch if I wasn't sure I could keep it below 65 degrees F (which I can't, generally speaking, with my current setup).