Yes, I'm from Finland so we have only single phase. Sorry that I forgot to mention that. But it seems like the common thought here is that it is a component failure. I will buy a new relay next week, hopefully I have better luck with that one.
Thank you all for your help. I will try to write...