When your army approaches to an enemy castle, a menu with three options (Approach the gates and hail the guard. Besiege the castle. Leave.) shows up. In this screen, when you hover the mouse cursor over the castle, the number of defenders is shown as the number of actual defenders plus the number of attacking army.