So, how do you do this exactly? I took over a castle and there was a Noblewoman in the dungeons, so I went to talk to her. But got "I am not allowed to talk to you". Though, fair, it's not my castle, hasn't been voted on yet.
Later on, got a different castle, and two noblemen in there. This...