Only to someone with an extremely simplistic point of view that says "anyone who doesn't want to force MY point of view on society is a liberal!"
Fact is most libertarians are pretty conservative in their personal views. They just aren't boorish enough to force them on others.
It goes both ways here. Liberals want to force their "alternative" lifestyles on everyone else. Libertarians oppose that in equal or greater measure, too.