Suggestion: In warband a defeated lord would retreat to nearest fief to recover health, which took a few days time. Maybe implementing this mechanic in bannerlord would help with snowballing?
In the current state, if you let any defeated lords go, they instantly return within a day with an army...