Officials across multiple government departments joined forces to raid the church service in Anhui province, eastern China.
NGO ChinaAid, which promotes religious freedom for Christians in China, said the incident took place last month.
The authorities raided a clandestine church inside a house belonging to Christian Yu Jiafang.
They confiscated religious items and bibles and threatened to punish Ms Jianfang.
ChinaAid claims the move violates the Chinese constitution, which enshrines freedom of belief.
China has launched a major crackdown on religion in recent months in an attempt to exercise control over the population.
Churches not sanctioned by the government have been put under surveillance with hundreds of Christians arrested for disturbing public order over offences such as holding bible study groups and displaying crucifixes outside their homes.
Members of the government-run churches also face strict monitoring with authorities clamping down on any dissidents.
Officers dragged out around 40 Christians with one worshipper comparing the brutal scenes to the Japanese invasion of China during the Second World War, according to charity China Aid.
China Aid said: “During the demolition, officials beat dozens of church members, pushing them to the ground and twisting their hands.
“The church was completely razed, and a church member likened the scene to the Japanese invasion of China during World War II.”
According to churchgoers Xi Jinping’s Communist Party ordered the church to be destroyed after branding the building an “illegal structure”.