I'd say you're probably fine. If the drilled hole is tight enough and won't pull through or put too much pressure on the tap connection, you're probably fine. The black collar just acts like a glorified washer and spreads the pressure over a larger area, but isn't totally necessary.
One option also is to get some Stainless collars
to keep that consistent look going!