Just do it in multiple tries, you can always flee after killing some, even if you die and have units in you army left you will be dragged out and can try another night. Actually this is something I like in bannerlord so far, you can't make assumptions, like "game makes me go into 6 vs 40, so I have to do this in one go", it's not necessarily logical, but it's fun to learn anew.