Yes., Madam. Your advocate is totally correct. Whatever you wanted to say, you must have mentioned in your affidavit. Now, it is the responsibility of the counsel of the opposite party to bring out the lies / contradictions / unmentioned facts from your affidavit. If you start to give a detailed reply, from that detailed reply, he would further develop questions, which ultimately may drag you in adverse situation. For example, in your affidavit you might have already said that he is "impotent". If the opposite party asks in cross examination, "Is he potent?" then you have to say "No." Then he asks, "how do you know"? For that your answer cannot be yes or no. You give a very brief reply (try to keep it one line or one sentence answer). You may say "he never consumated the marriage". Then he asks "how many times you tried"? Your answer will be - "Every night since our marriage, when we are alone". Simple answers so that further questions may not develop. Please do not try to insult your husband. Your approach should be to win the case and get relief and not to hurt any one. In that process, if any unavoidable hurt is casued to him, we cannot help it.
Wish you best of luck.