Nothing is said about Gerudo or women when Tetra says that, and she definately didn't say anything about good business. I don't know the exact words she said, but it was something like this:
"A band of pirates that we competed with used to live there, but now the place looks really dangerous."
A band of pirates USED to live there. They don't anymore. Plus, the Gerudos are pirates in one game: MM. And Termina isn't in the same dimension as Hyrule, so how can they have been living here? Unless they turned into pirates because of the sea, but I think it's just a little thing Ninty threw in to give Forsaken Fortress a bit of a backstory. It may of been Gerudos that Tetra and the rest were competing with, or might just of been a normal rival group of pirates.

__________________