Pakistan will allow the United States to question or take into custody the apparent wives of Osama bin Laden only if their “country of origin has been asked for permission,” a senior Pakistani intelligence source told CNN on Monday.

One of bin Laden’s wives is from Yemen, the official said.

Pakistani officials have said bin Laden’s family members will be repatriated to their home countries after initial interrogations are completed.

Pakistani Prime Minister Yousuf Raza Gilani on Monday delivered his first address to the lower house of Parliament since the killing of bin Laden, rejecting accusations that his government had failed to adequately pursue the world’s most wanted terrorist.

While calling bin Laden’s death “justice done,” Gilani repeatedly assailed U.S. violation of Pakistani “sovereignty” in conducting the operation without Pakistan’s knowledge or involvement.

“Allegations of complicity or incompetence are absurd,” Gilani said, referring to suggestions by some U.S. officials that there may be some within the Pakistani government or military who were helping shield bin Laden or failing to look for him. “We emphatically reject such accusations. Speculative narratives in the public domain are meant to create despondency. We will not allow our detractors to succeed in offloading their own shortcomings and errors of omission and commission in a blame game that stigmatizes Pakistan.”

READ MORE: CNN