Stone Tower is definitely more difficult than the Water Temple. All the flipping, fairy collecting, and time limit made it very challenging the first time I played it, compared to the Water Temple.
The Water Temple wasn't so much difficult as annoying, particularly with the lowering and raising of the water level. I always forget to raise the water level in the central tower to swim under the block that's raised.
