I generally Strong Bow + Khergit Arrows + Sabre + Kite Shield
Eh, not too good of a range here, but it works fairly nicely on horseback, dealing fairly hefty damage. 96 range - 96 speed I think for the sabre, 30 something damage...
using a bastard sword 1 handed is rather slow, I find, and ineffective, and a shield is VERY convenient if you find yourself unhorsed and mobbed. It can soak up damage for a while as you hack their numbers down (Sabre will generally 1 hit most ppl if you have decent aim/stats)...