Just because the Sages are involved doesn't mean the Sacred Realm is involved as well.

Arbiter Grounds is more commonly known as a Gerudo prison. Ganondorf was taken there to await execution by possibly the only ones who had the power to do so.