I prefer fighting on foot because I cant throw axes on horse
but the good thing about fighting on foot is that it is way easyer to use heavy weapons
my caracter is on level 42 and pretty well armoured so I can just charge in bradichy waving for some splatter and shrug off the wee little taps off the enemys pokes.
The thinng is if you are fighting against lots of cavalry just send in yours! and hang back with all of your infantry. when the enemy cavalry is dead or the last of them have killed yours just charge with your infantry.