Crossbowman
Equipped with a crossbow, a weapon of deadly proficiency even on untrained users.
Though crossbowmen have a slower rate of fire than archers, their weapon can penetrate
and deal much more damage to armored foes.
EDIT:
Pikeman
Equipped with a longer variant of a spear, a pike is one deadly weapon to thrust from a distance.
Combined, Pikemen will prove that wall of pikes are a death sentence. Not just cavalry, but infantry too.
Horse Archer
Saddled with a horse and equipped with a bow, these are perfect for harassing the enemy for a hit and run.
Even though they are perfect for harassing the enemy, they will have a hard time with armored foes, especially knights.