Why would you want to "attach" the collar to the freezer?
Mount the color on the original hinges. It'll be much easier to load kegs with the collar out of the way. Even if you don't use them, it's a much firmer hold than silicone.
Buy a second set of hinges for the lid portion. Doesn't have to be fancy. My keezer, deep freeze and fermentation chamber use door hinges.
Apply foam weatherstripping to the rim of the freezer. If you want, you can apply it to the rim of the collar as well. On my fermentation chamber, I applied the weatherstripping to the top of the collar, then silicone'd the weatherstripping to the original rubber seal. When I removed it to upsize the collar, it was not harder to remove than peeling the glue off the back of a
gift card.