As you can see, when climbing the ladder on the left side of the castle (I'm not sure what to call this scene btw) the AI get hung up on that section of the wall and will not move through the wall segments or go down the stairs into the inner courtyard.