> Does it matter what their productivity is as long as it's above 0

Slaves cost money. You have to feed and house them. Plus, they require security to keep them inline.

They have to be more productive per dollar than a free individual.