The basic target of that 4-slot design was giving player feeling of owning that village. He/she could even decide building a castle near it or player does not bother with a castle and focus on increasing production if that village is at safe zones. Of course building a castle was a very long process. This design gives player feeling of owning that village and player have a better connection with that village. Even when you walk around its scene you feel better in that scenario.