I did something similar with the baby swing and glider. I am sure the clock runs off of the batteries in series, so yes, 6V would be correct. I didn't solder them, instead I took a piece of wood dowel and mounted contacts to both ends. This way, I could pop it in or out just like batteries. Of course, I'm not buying you a new clock if it melts down.
For my application, I used in-line fuses as well.
Have to admit though, when I saw this thread, I pictured you having a transformer and some diodes with a mischievious look on your face.