On a constructive note to this argument, it is implied that the Twili were not initially from Hyrule, as their name implies, "interlopers." Not to say they WERE Termina folk, but this builds a pretty strong case.