Why did such a small percentage of southerners have large slave holdings

Slaves were an expensive commodity
Most Southerners were against slavery
It was difficult to control slaves
Purchasing slaves it was a time-consuming and difficult