In the campaign I joined the Empire as a mercenary and have fought with them for a few in game months. Now they are at peace and I want to leave the faction however if it do either by using the Kingdom menu screen or by talking to the ruler, I get -20 relations with the lords in the Empire. Is this supposed to happen even as a mercenary and is there any way fix it currently?