Only the capturing of cities and castles count towards "Eliminate <Kingdom>" quest progress. The defeating of parties or armies, regardless of size, does not, despite what the quest description says:
Defeat their armies or force them to make peace by capturing their settlements and destroying their parties to achieve victory.
Defeat their armies or force them to make peace by capturing their settlements and destroying their parties to achieve victory.