I think this is intended, if I recall correctly, Warband did the same thing with only sending in 10 units to attack a bandit camp. I think it's supposed to be a sort of a stealth mission so only your best men attack the camp at night.
It takes the first 10 soldiers in your party. So organize them to have your best soldiers there.