Like many others he has sent his family into hiding in the camps. The official's statements feed the doubts about the departure of the first Rohingya group to the Burmese western state of Rakhine.
Canada has also underscored the role of the Office of the UN High Commissioner for Refugees (UNHCR) in determining how voluntary Rohingya returns are, and to ensure that the process is based on informed consent.
The group said 150 people from 30 families were to be transferred to a transit camp on Thursday, but the camp was empty except for security guards. "We do not trust them [the Myanmar government] as they did not keep their promise".
Hundreds of Rohingya refugees shout slogans as they protest against their repatriation at the Unchiprang camp in Teknaf, Bangladesh on Thursday.
"We urge efforts should be made to correct the wrongdoings", he told Malaysian media on the sidelines of the summit.
"We understand our country better than any other country does.so we are in a better position to explain to you what has happened, how we see things panning out."
Win Myat Aye said Myanmar authorities had vetted an initial list of returnees submitted by the government of Bangladesh and found that 65 were "terrorists" who were not welcome back.
"If we need to go, we demand that we go back to our homes, not to any camps there".
"These women, men and children would be sent back into the Myanmar military's grasp with no protection guarantees, to live alongside those who torched their homes and whose bullets they fled", said Nicholas Bequelin, Amnesty's East and Southeast Asia director.
At the Jamtoli refugee camp, one of the sprawling refugee settlements near the city of Cox's Bazar, 25-year-old Setara said she and her two children, age 4 and 7, were on a repatriation list, but her parents were not.
"They killed my husband; now I live here with my parents", said Setara, who only gave one name.
Kalam earlier said none of the 50 families spoken to so far "expressed their willingness to go back under the present circumstances" and "We can not force them to go back against their will".
More than 700,000 Rohingya Muslims and others have fled to Bangladesh over the past year.
Myanmar and Bangladesh have agreed they should gradually be returned to Myanmar and thousands of people have been approved for return by Myanmar.
Bangladesh appears set to begin repatriation of Rohingya refugees to Myanmar on Thursday despite overwhelming evidence that none are willing to return voluntarily. The scale, organization and ferocity of the operation led to accusations from the worldwide community, including the United Nations, of ethnic cleansing and genocide.
More than 700,000 Rohingya fled a brutal army crackdown in Myanmar's Rakhine state previous year, accusing government soldiers and local Buddhists of massacring families, burning hundreds of villages, and carrying out mass gang rape. Almost all Rohingya have been denied citizenship in Myanmar since a 1982 law went into effect.
The refugees are living in crowded camps in Cox's Bazar.
The United Nations has recommended that top military leaders in Myanmar be put on trial for crimes that include genocide.
Access to education and employment has been far from assured. Many in the Buddhist-majority country call the Rohingya "Bengalis", suggesting they belong in Bangladesh.
The UNHCR, who have actively opposed the repatriation plans out of concern that the current conditions in Myanmar do not guarantee the rights and safety of the Rohingya, began a process of interviewing every refugee on the list to determine whether they wanted to return but struggled to find majority.
Myanmar's leader Aung San Suu Kyi has come under fire for not doing enough to avert the crisis.
Negotiations for repatriation have been going on for months, but plans last January to begin sending refugees back to Myanmar's Rakhine State were called off amid concerns among aid workers and Rohingya that their return would be met with violence.