Saying otherwise is completely ignoring the opportunity cost associated with the church confiscating resources back when religion was not voluntary at all. (The church had armies, torturers, spies, and from the top, operated like any other power structure.
And again, this does NOT mean there were no good people or actions, just that it is important to put it all in context. The simple test is the one that works for nearly EVERYTHING: "were people acting voluntarily or being forced?" Voluntary is good, and forced is nearly always very bad. No matter how it is spun.