I've been meaning to post something on this, as I've encountered something kind of similar (though perhaps a little more extreme than your issue). I've made half a dozen BIAB beers, all of which turned out fine or better, so I'm happy that the method works and makes good beer. However, last year I made a Strong Dark Belgian using the BIAB method, and to try to maximise efficiency, after I took the bag out of the mash kettle (or whatever you call the big pot you use in BIAB!) I put the grain bag in an ale pail and sparged by pouring two or three pots of 170F water over it. I then added the sparge-water back to the big pot and started the boil. After the beer was fermented and bottled, it had a really nasty flavor to it - the closest description I can think of for it is to describe it as a kind of astringency. It was sufficiently unpleasant that I thought it must have been some kind of infection, but no description I've found of infections fitted that taste. It was the only BIAB beer I'd done that with, so I presume something nasty must have been extracted when I sparged the grains.
To test that theory, when I made a BIAB IPA last month, I sparged again but this time kept the sparge-water separate, and used it to make a small partigyle pale ale. If sparging a BIAB beer imparts nasty flavors, then the (unsparged) IPA should be fine, and the (sparged) pale ale should suck ass. I bottled both beers about three weeks ago, so over the weekend I'll taste them and see whether my BIAB sparging imparts unpleasant flavors. I'd be slightly surprised if it does, as I can't think why BIAB would be more prone to extracting tannins or other undesirables than regular mashing. But it is a (relatively) new method, so there may be BIAB-specific differences yet to emerge. If anyone else has had similar experiences it'd be good to hear about them. And equally, if people have BIAB-sparged with no problems at all, that'd be good to know too.