Your leadership is a function of your charisma level, and the relationship is leadership can not be increased beyond 1/3 of your charisma level.
As noted, your character screen explains the relationships, click on the appropriate skill and in the upper right corner you'll see the text.