I agree that they could make the time that you recover (when falling off a horse) faster.
There are actually several ways to kill infantry, from behind and from the front. Cavalry is weak, though.
Especially the horses. The horse weakness ruins it everytime for me, maybe they should make horses a little tougher.
That's it, actually. I have nothing more to complain about cavalry.