Name change in the middle of employment process?

I got selected in a central government agency. In the middle of the recruitment process I had to change my name (due to personal reasons) but the officials are not accepting it and asked me to submit my certificates in the name same as in the application form.

I have explained everything clearly in the attachment. Please download it and help me to find a possible solution.

Thankyou

With regards,

Riyaz