In this game you usually improve relations with your fief or city, in order to recruit more and better troops without the need of training them.
From a game point of view, I think it's also the main reason why you don't give the possibility to recruit Garrison directly from City or Castle, if...