Legal ground for slander?

There is a man who really interested in a romantic relationship with my wife. Regardless of all emails that he sent to my wife, there is a letter that he encourage my wife to take action against me for what I did not do, he also said that I have involved an affair with someone. This is totally not true and what he did does damage my family happiness. Do I have a ground to sue him for slander?