Siege towers have to be made more effective than ladders. Not sure what do do though
I think the only way to fix is it for the siege tower to be more protected, i.e adjust the mesh or create a new one. My idea would be to Just add some board along the sides as Llew suggested.
What's this from? MaB Realism?
Was planned to be, but it's too demanding for a siege.