I have no problems getting lords to follow me. I am faction leader in theory of the muscovites having overthrown stepan and the Tsar but they drift off very quickly. My relations with them are very poor so i assume that's why. Some don't even stay a day. I have been generous with my gifts of land and castles so i don't know why i'm so unpopular. Maybe I'll go on a charm offensive with my own lords...