Not only on high levels, I was about to make a new post for it. So far since level 1 I only managed to get villages looted doing that quest, the bandit archers are insane, and almos one shot the peasants.
Probably some weapon rebalancing issue and now they are gods ammong mere bandits, number of bandits should be balanced by that. I dont have problem with other bandits.
The wedding party quest is also a bit insane, you have to face what 40 units all packed togheter.