While we wait for the snowballing to be fixed, I came up with an idea- When ever the player is captured by bandits, they should sell the player to a hostile faction. Adds a bit more immersion to be sold to your enemies rather than a looter just dragging around a faction's most influential general.