How long were you in primary?
Unless you fermented absolutely dry, you should still be producing some CO2 during secondary and this can help blanket your cider in its vessel. The off taste could be merely raw green cider on its way to goodness.
While the above is true, it is always good practice to minimize headspace while racking.