In this case, I would move it to a secondary if you're going to be adding more fruit.
I generally don't move to a secondary unless I'm adding dry hops, oak, fruit or aging it for a while. I think John Palmer said it best on one of the brew strong podcasts (not quoting exactly): yeast don't...