I love this list and refer to it all the time now
Here's an addition for Port Royal:
Graham Marsh: Graham Marsh Imports - Part of the Karbay Benedek quest.
In building just past drydock. Door is facing the last dock and the tall peak
And Tortuga:
Blacksmith Flinty - Flinty's Smithery - Part of the Doc Grogs Kraken Eye quest. Located by the Kings Arm tavern