For anyone having this issue I have found a temporary work around. If another army attacks and kills the bugged bandit party it will respawn with full troops which can then be attacked by you. Best thing is to wait nearby until you see someone attack the party and once their battle is over look around and you should find a replacement bandit party you can defeat for the quest.