You know in MM it says that Link crept away from Hyrule? In the Colecter's Edition strategy guide it says that he was in Lost Woods. So he didn't leave Hyrule in the begging. I think in Lost Woods is where the portal to Termina is located.
This Golden Realm is much darker than I thought it would be.