Personally not a fan of it, never have been. It's basically the same as it used to be in Warbands, except with duels added in, and way more detailed hideouts of course.
I wouldn't mind it so much if I got to pick and choose who to take with me, but so far I've been getting unlucky in the sense that any dirty peasants I have in my party are the ones who get dragged into the Steppe Bandit/Forest Bandit camp. And if you know those bandits, you know that fighting those fellas without shields is a good way to die, and all these smelly little recruits certainly didn't think to strap some wooden boards together for protection sadly.
One thing I do like, however, is that if you get dropped, and by some miracle your handful of men can purge that army of bandits, then you don't necessarily get captured and have to lose it all because of some stray arrow like in Warbands. Granted the duel still does that if you lose, but I'm not too concerned overall about them working on it, I can just use some mods that some goodly folk have already made to tweak things to my preference.