Racking is not a problem if done carefully. However, the extra headspace can cause an issue. If you are capable, purge the oxygen from the headspace with CO2. Otherwise, it might be a better idea to wait a while longer in primary, rack to your secondary as a holding tank, clean your primary and rack back to it immediately for bottling.
If you used a bucket with a spigot for your primary, make sure to take the spigot off and clean it thoroughly. I'd hate or you to infect a beer during bottling because you overlooked that.