Many brewers don't strain their wort and just dump everything in, hops and all and their beer doesn't taste like cleaning solution. Many brewers leave their beer a minimum of 1 month in primary, and have left their beers in even up to a year and their beers don't taste like that either. Those are pretty common things brewers do.
What do you mean by "cleaning solution?" Does it taste like you didn't rinse the soap out of the gear before using it?
Does it taste like acetone/nail polish? If that's the case it could be from two high a fermentation temp, or from an infection. What was your cleaning sanitation regimen like?