The problem is both the ignorant (religionists) and hard materialists. The horrors perpetrated by the religionists are what drive the hard materialists to a totally dualist (mind is unknown) or no mind at all. But the rise of panpsychism to dominance will ultimately prevail by making them outliers.
A chunk of the ignorant will go to their graves but their numbers are already shrinking quickly. Once the fascist movement collapses in the face of reality there will be no other reason to support the old religions except personal refusal to change.