"Raise the Meek" Skill in Leadership, but Looters are way faster.
You get XP for any combat, it doesn't have to be looters, they're just the safest. But if you draw sea raider's Javelins before a charge, even a peasant army can beat sea raiders if you got like a 2:1 advantage or more.