It just isn't wise to take away the handouts that people are entitled to simply to defend the assets of those who have more than they really need. The rich are but a tiny minority, so it isn't like they can stop the wealth transfer anyway. In a democracy, what the majority says goes, period. If the majority say that the minority must work to make life easier on the majority, then that is indeed proper.
For example, if there is a particular group of people who are genetically adapted for hot conditions and have a track record of harvesting a certain crop, say cotton, then those people should be compelled to perform such work even if they don't want to if the majority says they should.