I would say that, but the temple is filled with physical bones, torture devices with puddles of blood around them, undead creatures fill the building, and it is haunted by spirits of people who died in it.
The creautre in the building, based on its nature, fed on people and its room is alligned with bones and skulls (vaugely seen, but you can see it if you look good enough), indicating that Dead Hand fed on corpses of people there in the past.
A one-eyed man created the Lens of Truth to actually safely nagiagate the temple, and benath his house is, yet again, dead bodies, one of the same torture deivces from the Shadow Temple with blood around, it is haunted by spirits, and it shows the man who navigated out to be a psychopath. The same Dead Hand creature, which for all we know could be him, was in his basment. His house is gone by the events of Ocarina of Time, but the lens was found hidden benath where his house was, along with a one-(red)red monster sealed down there with the lens.
This shows that whoever used the Shadow Temple (the one-eyed man, in paticular) was a psychopath who was sealed in his own slaughter house of a basment along with his lens. What we have their is that the temple was used by someone not right in his own mind, a man whose basement is a hellish slaughter house and he was presumably sealed down there with the lens, where he appears to have become
my friend.
His apparant demonic form also has severed hands and no head, with the neck acting as his single eye, this shows that he himself was killed in a fashion involving severing his hands and head, which looks like what those torture devices do...
There are also what appears to have things in the Shadow Temple used for burning dead bodies and getting rid of them.