The natives didn't have immunities to Old-World diseases such as smallpox and malaria. Over 90 percent of the native population either died from the diseases or simply ran away and hid in the jungle.
Africans, on the other hand, possessed the required immunities.