The incident took place in Sarakdanga, a village near Naogaon.
The imams visit the Christian converts twice a day to convince them to return to Islamism.
Local officials claim the church was being illegally built in a forest reserve.
Forest Department officials tore down a Seventh-day Adventist church in Bandarban district for lack of construction permit.
Police claim the incident is a land dispute and deny the existence of the church
Muslim extremists of Bangladesh go from house to house and force Christians to deny their faith and pray Muslim prayers.
More than five hundred Rohingya refugees were affected by the fire; there were also some Christians among them.
Even though they fled Myanmar, they are still suffering from persecution in the refugee camps.