In Warband, I’ve always found how during the mid to late game whenever your Kingdom expanded, the number of lords to patrol your territories rarely if ever increased. This resulted in a small handful of lords coming into possession of 7-8 territories to their name that they could not possibly defend, often leaving border of burned villages in their possession against smaller kingdoms that had fewer territories but better lord distribution. Hopefully, in Bannerlord this is resolved in some manner, be it clans having relatives spawn in as companions/minor lord parties to patrol territory, lords hiring more companions as their holdings increase to patrol fiefs, or nobles trading territory with each other to make sure their fiefs are close together.