Yes, I definitely considered that option, and the heated insert tool that is made for it, but for the tap handles, the acetone trick and just pressing them in by hand, works just fine.
For small inserts, I'll certainly consider your advice. I just haven't had anything that's needed them yet.