I think a second garrison slot for a patrol or just patrols that auto spawn from garrison troops would help liven the game up. As is it they sit in the castle/town and starve to death while they watch looters and bandits kill the villagers outside the walls so no food trading gets done.
If...