It was only the ability to forsee abuse that allowed the Founders to craft an framework that, if studiously adhered to could endure. Unfortunately, the greed of the power brokers in the North found ways to subvert that, and as early as 1830, Calhoun was raising hell over northern railroad bridges which were to cross major rivers at heights too low to permit serious steamboat traffic, rendering the shipping a monopoly.
Habeas Corpus was suspended, the 'detainees' included the grandson of Francis Scott Key (author of the Star Spangled Banner), who was imprisoned, among other places in Fort Mc Henry. Maryland was heavily Southern in sentiment, and spent the war as an occupied State. The Uniion didn't have any qualms about press ganging slaves to move their stuff.
Or drafting the Irish right off of the boats. As you probably know, the worst riots in US History were the New York draft riots. For some odd reason, if you had enough money you could buy your way out of the Draft. For wealthy power brokers in New York, coming up with $300.00 to buy your freedom was not difficult. For the working class it was almost impossible.
During the draft riots, one of the slogans they shouted was "Our lives are worth less than a slave!" Slaves at the time cost around $1,000.00.
They killed 120 black people by hanging, shooting, stabbing, beating and burning. Apparently there was no brotherly love going on there.
Nobody wanted to be pressed into involuntary service and sent into other states to kill people who had done them no wrong.
But of course we had to use involuntary servitude or else those people wouldn't have fought, now would they?