No doubt you were not able to repay the loan amount on time and ther is a huge outstanding.
However the banks cannot send agencies to your home especially the rogues in the garb of agencies.
You can issue a legal notice to the bank to refrain from sending such thugs to home or else you will be constrained to lodge criminal complaint against their illegal activities in the name of recovering the loan amount.
You can ask the bank to initiate legal action through court for recovery of loan amount instead of adopting such illegal tactics.
When they approach court, then you will get sufficient time for the case to be disposed, in the meantime you can arrange funds and repay the entire loan amount.