Calling people Folks is calling them people with souls, likeable and American. People are just people and another way of saying humans in numberrs. Has nothing to do with being dumb when you say folks. If you feel you need to call someone dumb, it is best to just forget it.
My folks are my parents. You folks are persons I care about. The other folks are the ones I know little about but they count anyway.