I have had the same issue occur twice. Both seem to have happened during a battle between two armies. The defending army defeats the attacking army, and the prisoner seems to go straight to the fief's dungeon. They become inaccessible in the dungeon and are stuck there even after peace. My only fix was to play the long game and take over the fief, which releases the prisoner.