they do very slowly.
And the bigger it gets, the slower it'll increase.
to be honest, just throw a bunch of sub par troops into garrisons you intend to give to other lords.
It'll be more than enough to keep away single lords, which is what's important.
