So, what do you think I can do to prevent the relay's contact from being welded together?That does sound like the relay is releasing. The pun intended but the point is also true: things are moving inside to make the noise.
That does not mean the contacts have not welded together: I believe I've had some open frame relays that still "clicked" but I could see the contact lever stay in one connection.