Yeah, you have to wait for the sieging party to initiate an assault. It's one of the wrinkles that peeve me somewhat about sieges, you can't assault a castle that someone else is sieging, you have to wait for them to attack or leave, with the latter being more likely and significantly more annoying.
"Well boys, we've camped outside this castle for two weeks now and our allies over there have patiently waited for us to move in, so I guess it's time to pack up and clear out now."
