I'd be very shocked if they used cardioversion on you with a heart rate less then 180 so dont worry, I think your cardiologist was trying to scare you.
While A-Fib can cause serious problems it is also fairly easy to treat so dont let them get ya to scared. Take your meds as prescribed...