If that is your power ON switch in the first pic, I think you have it mis-wired. The wire from the power supply should be on one of the middle connections, and the wire to the fan should be on the normally open connection on the same side of the switch.