How many Hyrule Castles are there?

OoT's castle is destroyed by Ganon and rebuilt before The Wind Waker.
This makes 2 castles.

LoZ probably had a castle destroyed by Ganon, since it was the LoZ region
Ganon invaded and stole the ToP from:

In the midst of this chaos, in a little kingdom in the land of Hyrule...Zelda, the princess of this kingdom...

^ We also see that Zelda is the princess of the LoZ region, further suggesting a
castle was there. If I had to hazard a guess, I'd say that the "desert" region of
the LoZ map was where the castle once stood -between Eagle Dungeon and
Moon Dungeon, which I equate with Lake Hylia and OoT's Lost Woods.

If the LoZ castle was rebuilt, and OoT -> LoZ, that makes 3 castles.
If there is a castle after the flood (PH/ST), then we have yet another castle.
That makes about 3-4 castles (but not all on the same timeline, perhaps..)

The castle in TP got destroyed as well. Then we have some castles that don't look alike but aren't necessarily new castles, could just be expanded/remodeled.

On the CT I have three castles. Perhaps four on the AT, though unknown till ST.

AT: North Castle;OoT Castle;tWW Castle(;Post-Flood Castle in 'little kingdom' if there was one)

CT: North Castle;OoT Castle;TP Castle (and its rebuild- reckon was just renewed/fixed rather than whole new castle)