You're absolutely right! I have a friend who homeschools her 9 children. Her husband works and they do not receive welfare. Yet OLDER WOMEN walk up to her in the grocery store and other places to express their disapproval of her large family. Others have accused her of crippling her kids socially, because they don't go to public schools.
Also, when my coworker's wife was expecting their 3rd child, he got criticized for acting "irresponsibly."