The lose if you get dismounted rule is actually an interesting mechanic IMO, it makes it less skirmish like sure but it is way more Duel like.
Just protect your horse, it also prevents people from just holding up their shield as you cannot kick and makes the fight way more dynamic.
Horses have a ****ton of HP so in close combat it is hard to do a lot of damage to a horse