I had different versions of this happen to me. I kept falling through my Sloop but could jump back onto it. But I did end up falling underneath Tortuga once, had to close out the game.
...what's really sad though, I had no idea I could teleport! I visited each island by ship first! Argh! Thank the rum makers there's this forum and I picked up that I could do it!!
