I noticed a pretty big clitch in the AI when defending flintolg castle (and other castle like flintolg). I had this issue twice with this type of castle. From what i can tell it looks like when the attacking AI doesnt build a Ram or a siege tower (meaning they need to use ladders), they go in...