NBW

A Non-Bailable warrant issued against an Accused can be cancelled at any time before it is executed. 

Since you have already been granted bail by court, and the court had issued NBWs against the accused on account of non appearance in court on date, you should file an application

Cancellation of non bailable warrant - U/S 70 (2) of CrPC 

before the concerned court seeking recalling of NBWs orders by stating reasons for your non appearance on the relevant date. You should mention such a reason, whereby it was beyond your control to put in your appearance in court on the date. By moving such application, you can seek cancellation of the orders of the issuance of the warrants. Your previous conduct of appearance in the case will also have an impact on the orders to be passed on the application

You can be arrested anytime better to file it as early as possible like tomorrow

Courts will cancelled that immediatly if you appear personally, when court cancelled that order of NBW

Request the court to give you a copy of its latest order so that police cannot harras you.

there is provision for it u/s 363crpc