Problem with companion prisoners

[Count Jalan]

So I made Alayan a lord but since he is a jealous prick he started hating me for giving land to other lords and eventually joined the Rhodoks who I am at war with. I took him prisoner and tried to deposit him at one of my fiefs but couldn't and later he just said it isn't working out and bloody left.

Anyone else have this problem or know a way on how to fix it?

 

[Scottport]

I had the same problem after awhile I went to my town and the companion was at the castle and when I spook to him I was able to get him to rejoin my army as a companion again