I have brought a grand solution to your problem. It's called a spear and it works quite easily.
>Point spear at horse
> Hit attack button at right time
>Horse is now block and you get a free hit on the rider
>If you have a teammate or two the cav is now dead