How to successfully defend a settlement post capturing

[Beau Vine]

I have never had them give me one damn troop when I was the one receiving the castle or town.

Better check on that.

My neighbours have a nasty habit of dumping a bunch of peasants and Battanian volunteers when I'm not looking, leading to dip in prosperity due to foodstocks being eaten by 50-100 useless units.