Secession was never the issue. Of course, any state has the right to secede. But not simply so that they can continue to violate the personal liberty of its citizens.
America had an obligation to invade the South to end the barbaric practice of slavery, whether it was a foreign country or not. After it was beaten, it was re-absorbed. To the victor goes the spoils.