Libertarians adhere to the Golden Rule. We respect the property rights, and civil rights (including the right to privacy) of our fellow citizens, and demand the same in return. That's hardly a "radical" idea.
You think it's okay to use government force to bend others to your views on morality. For example, you probably think it's wrong for people to get inebriated on pot, or cocaine, or whatever (everything but alcohol, presumably), therefore you support the atrocities committed in the war on drugs, against citizens who've done no harm to anyone else. That's not liberty, my friend. That's oppression.