The borders. It was based and developed on the idea that the cotton producing and other "Goods States" had more value with slaves. Abolishing slavery would in turn take its toll on the states.
Population, there were a lot more people in northern states while the south had a lot less, which caused southern states to see the divide between north and south unfair
