Lucrative sugar plantations were often centered on a manor house with attendant buildings. Their warehouses were often filled with valuable goods to be traded... or stolen by those unwilling to foot the bill.
Notable Examples:
Cat Island
Matanzas
New Bone
Tortuga