How long ago did you pitch the tube? If you see yeast settling on the bottom, and you are past having a high krausen, I bet you would be okay to let it settle for another day or so, and then decant off most of the starter beer, swirl up the yeast and pitch. Pitching for secondary doesn't really require a large amount of yeast, the Brett can get going on just a vial, but of course higher numbers will help it produce faster. I don't think you'll hurt the beer if you don't pitch immediately, its not imperative to inoculate as soon as possible, the Brett is working on sugars and dextrins the Abbey yeast was leaving behind. If I recall for my clone, I was away and couldn't transfer and pitch for maybe two weeks after brew day, and things worked just fine. For the kit Vinnie recommends transferring and pitching when the gravity has settled at 1.016, which was right where mine was when I pitched along with adding the currants.
Don't stress, you're on the right track, having boosted the Brett population with the starter you will be pitching strong, healthy, ready yeast in a greater count than came in the vial. I'd still recommend decanting.