Rental agreement

Hello lawyers I rented one party on March 4th 2016. He paid 2 laks advance. Same day agreement was also signed. On 7th March he told me that he wants to cancel the agreement since his family is not interested in starting business. And asked me to pay deposit money immediately.When I said as per agreement I need sometime to refund you. He says that he has not moved in with his property and agreement will be valid only when he starts his business. He is threatening me that he will insult me in my office and home. Even though u have agreement the dignity in your office and home will be destroyed. What can I do now to stop him.? I am not cheating but how it is possible to refund the amount in just 3 days.