I agree, when I first walked through the Gate of Time in SS and found myself in the old Temple of Hylia, I was so disappointed to discover that you couldn't go anywhere....until the final battle, in which case you still can't leave the Sealed Grounds. Would have been nice to have seen the world in that time....although, just exactly how would it have looked? This was just after the battle between Hylia and Demise.