For keg lines and faucets, you actually should use Beer Line Cleaner (BLC), which also uses a pump to push the cleaner through the faucet threads to your tap end.
And yes, when cleaning the lines, and whenever changing kegs, always clean the taps and faucets. Use a small faucet/tap brush to...