Not sure, but was it intended, that Athenian long walls (can be built in neutral territory) and roman siege walls (can be built everywhere) also decay?
You need to garrison them all the time.
And Gates will always decay, because you can't garrison them, so they will be useless for the siege walls and the athenian long walls.
